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Abstract 


JJe 


tudy  ^he  properties  of  the  deterministic  equivalent  program 


of  a  stochastic  program  with  recourse.  After  a  brief  discussion  of 
the  place  of  the  stochastic  programming  model  in  the  realm  of  stochastic 
optimization  and  the  definition  of  the  problem  under  consideration,  the 
three  fellowAtva. -sections  ere  devoted  tb>  the  characterization  of  feasible 

...  i,  ■  -  V"*' 

solutions^.  The  -  two  leefc-  eeetioae-  examine  the  various  properties  of 
the  objective  functions  (dependent  on  or  independent  from  the  type  of 


distribution  of  the  random  elements) . 


( 


N 


1. 


Introduction 


In  the  first  part  of  this  survey,  we  shall  be 


particularly  concerned  with  the  properties  of  the  deterministic  equi¬ 
valent  program  of  a  stochastic  program  with  recourse.  We  shall  restrict 
our  attention  to  the  two-stage  linear  problem  with  fixed  recourse. 

These  limitations  have  for  principal  purpose  to  simplify  substantially 
the  presentation.  However,  whenever  it  will  seem  to  be  appropriate 

we  shall  indicate  the  extent  to  which  certain  of  these  results  can  be 

+ 

generalized.  On  the  other  hand,  although  the  title  indicates  that 
this  paper  is  essentially  a  survey,  a  fair  portion  of  the  results 
mentioned  here  have  never  appeared  in  print;  most  of  these  can  be  con¬ 
sidered  as  sharpened  versions  of  propositions  which  have  appeared 
previously  or  as  a  different  approach  to  known  results,  which  allows 
for  a  somewhat  more  satisfactory  treatment.  A  few  results  are  genuinely 
original. 

We  do  not  intend  to  give  an  historical  account  of  the  various 
developments  in  this  field}  however,  we  shall  try  to  sketch  the  evolution 
one  can  observe  in  the  statement  of  the  problem  as  well  as  the  various 
techniques  which  have  been  used  to  resolve  some  of  these  difficulties. 

The  following  parts  of  the  survey  will  be  devoted  to  some  characterizations 
of  the  optimal  solutions  of  stochastic  programs,  to  the  nonlinear  and 
multiple  recourse  formulations  and  to  some  computational  experiences  as 
well  as  a  few  selected  applications. 

1 

Some  generalizations  are  so  trivial  in  nature  that  they  might  remain 
unmentioned. 
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Before  we  give  a  precise  mathematical  definition  of  the  problem, 
it  might  be  worthwhile  to  place  this  class  of  problems  in  a  somewhat 
larger  context.  Consider  a  decision  maker  faced  with  various  alternatives. 
His  decisions  are  subject  to  a  certain  number  of  constraints  and  his  goal 
is  to  optimize  a  given  criterion.  However,  at  the  time  of  his  selection 
of  one  of  the  alternatives,  some  of  the  parameters  of  the  problem  are 
unknown  to  him.  The  amount  of  information  which  is  given  about  these 
parameters  divides  this  family  of  decision  making  problems  into  two  main 
classes  to  which  the  economists  refer  as:  decision  making  under  uncer¬ 
tainty  and  decision  making  under  risk.  In  this  first  class  of  problems, 
essentially  nothing  (or  very  little)  of  a  quantitative  nature  is  available 
to  the  decision  maker.  In  the  second  class,  it  is  assumed  that  the  decision 
maker  is  given  a  description  of  these  unknown  parameters  in  terms  of  a 
well  determined  probability  law.  (Various  papers  have  studied  models 
where  some  partial  knowledge  of  this  probability  law  is  available.  In 
[Miyasawa,  1968),  and  [Avriel  and  Williams,  1969]  one  can  find  a  discussion  of 
information  structures  in  stochastic  programming  problems.) 

The  term  Stodhastio  Programming  will  be  reserved  for  those  pro¬ 
gramming  problems  which  fit  in  this  second  class.  In  the  literature  one 
finds  various  papers  dealing  with  mathematical  programs  whose  parameters, 
or  some  of  their  parameters*  are  random,  but  which  by  our  definition  may 
have  little  to  do  with  stochastic  programming.  Some  of  these  papers 
discuss  various  problems  the  importance  of  which  ranges  from  amazing 
mathematical  puzzles  up  to  some  important  and  sometimes  difficult  questions 
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whose  solution  would  most  definitely  enhance  our  chances  of  solving 
"difficult”  stochastic  programs.  For  example,  a  complete  solution  to 
the  distribution  problem: 

Find  the  distribution  function  f>f  Q(A,b,c) 
where  Q(A,b,c)  *  {Min  cx  |  Ax  -  b,  x  i  Oj 
and  A,b,c  are  random  matrices, 

is  neither  expected,  nor  is  it  necessary  for  solving  a  large  class  of 
stochastic  programs;  however,  it  is  obvious  that  any  additional  insight 
one  might  gain  in  this  question  could  prove  very  worthwhile. 

Rather  than  giving  an  axiomatic  definition  of  a  model  for  stochastic 
programs,  as  can  be  done  for  linear  programs  [Dantzig,  1963,  Ch.  3], 
we  shall  limit  ourselves  to  some  of  the  characteristics  of  stochastic 
optimization  problems.  In  some  sense  we  shall  try  to  point  to  those 
properties  which  constitute  the  essence  of  stochastic  optimization  models. 
First,  perhaps,  the  sequential  nature  of  the  problem,  i.e.,  the  decision, 
is  selected  before  the  random  elements,  say  £,  of  the  problem  can  be 
observed.  Second,  the  solution  is  the  selection  of  one  particular  decision , 
say  x  in  JX ,  where  JC  denotes  the  set  of  alternatives.  Third,  the 
actual  value  z(x,£)  of  a  given  decision  can  only  be  determined  after 
observing  £.  Fourth,  it  is  assumed  that  the  decision  maker  has  a 
definite  attitude  towards  risk  described  by  some  function,  say  u,  which 
usually  has  all  the  properties  of  the  standard  utility  function  in  mathe¬ 
matical  economics.  In  particular,  this  implies  that  the  criterion  for 
optimization  can  always  be  expressed  in  terms  of  the  maximization  (or 
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minimization)  of  the  expectation  of  utility.  Finally,  it  is  assumed 
that  the  probability  law  of  £  Is  completely  determined  once  a  parti¬ 
cular  x  is  selected,  i.e.,  we  are  given  the  probability  space 
(Sx,£7,px)  on  which  £  is  defined. 

Thus  a  very  abstract  formulation  of  a  stochastic  optimization 
problem  could  be: 


Given  [(Hx,^,mx)  ^af,z,u], 
find  inf  E{u(z(x,£))} 

We  do  not  Intend  to  develop  any  further  an  abstract  theory  of  optimization, 
nor  do  we  intend  tc  make  any  specific  use  of  the  above  moiel.  Our  purpose 
in  formulating  a  fairly  abstract  stochastic  optimization  problem  is 
th  it  it  might  serve  as  a  point  of  reference  whenever  we  study  any  parti¬ 
cular  model  for  stochastic  optimization.  Many  problems  studied  in  mathe¬ 
matical  economics,  operations  research,  system  engineering  and  control 
theory,  fit  into  this  class  of  optimization  problems:  e.g.,  Markov 
Programming,  Inventory  Problems,  Stochastic  Optimal  Control  Problems,... 
Determining  to  which  category  a  given  stochastic  optimization  problem 
belongs  is  irrelevant.  In  practice,  these  categories  have  considerable 
overlap,  e.g.,  the  newsboy  problem  which  is  probably  the  first  example 
of  a  stochastic  programming  problem  found  in  the  literature,  is  usually,  and 
rightfully  so,  thought  of  as  belonging  to  that  class  of  problems  dealt 

t 

Briefly:  Given  a  distribution  of  demand,  a  purchase  cost,  a  selling 
price  and  given  that  no  unsold  papers  can  be  returned,  a  newsboy  seeks 
the  optimal  number  of  papers  to  order  so  as  to  maximize  his  expected 
profit. 


with  in  inventory  theory. 


The  first  formulation  of  stochastic  programs  with  recourse  was 
given  by  G.  Dantzig  [Dantzig,  1955]  who  called  them  linear  programs 
under  uncertainty,  and  by  E.  Beale  [Beale,  1955]  who  used  the  name  of 
linear  programs  with  random  coefficients.  Beale's  formulation  can  be 
viewed  as  an  n-dimensional  generalization  of  the  newsboy  problem. 

Dantzig's  formulation  is  in  some  sense  somewhat  more  general,  but  still 
includes  many  of  the  particular  properties  of  the  n-dimensional  news¬ 
boy  problem.  (See  in  particular  the  application  [Ferguson  and  Dantzig, 
1956]  which  motivated  Dantzig's  work.)  As  already  mentioned  above  the 
actual  formulation  of  the  problem  has  not  remained  scatic;  this  was 
essentially  due  to  the  necessity  of  widening  the  range  of  possible  appli¬ 
cations  as  well  as  to  the  desire  for  somewhat  more  rigorous  mathematical 
foundations  for  the  theory.  Although  we  will  not  pursue  this  objective 
here,  this  "grown-up"  model  for  stochastic  programming  also  allows  for 
a  more  interesting  economic  analysis. 

2.  Statement  of  the  Problem.  Let  4  *  (c(4) ,q(4)  ,p (4)  ,T(4))  be  a 
random  vector  defined  on  a  probability  space  where  S  is  a 

Borel  subset  of  R^,  N  =  (n+1)  (in+l)  +  n  -  1,  9  is  a  a-algebra  containing 
the  Borel  subsets  of  5,  y  is  a  probability  measure  defined  on  S.  The 
coordinates  of  a  point  4  in  5  is  a  collection  of  four  matrices 
c,q,p  and  T  of  dimension  1  *  n,  1  x  n,  m  *  1  and  m  x  n  respectively, 
i.e.,  c,q,p,  and  T  are  projections  of  4  •  By  F  we  denote  the 

cv 

distribution  function  associated  with  p  and  by  E  the  support  of 
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the  distribution  of  £,  i.e.,  the  smallest  closed  subset  of  R  of 

measure  1. 


Definition  (2.1).  If  for  all  i,.i,k  the  random  functions  Cj(£)» 

<I.i(0p.(0  and  q  (Ot..  (£)  have  first  moments,  then  the  random  variable 
j  i  j  lie 

?  is  said  to  satisfy  a  (weak)  covariance  aendition.  We  shall  assume 
that  such  a  condition  is  satisfied  by  the  random  elements  of  the  problem. 

From  a  practical  viewpoint  this  condition  might  seem  difficult  to 
verify,  however  it  is  easy  to  see  that  if  £  has  variance,  then  assumption 
(2.1)  is  automatically  satisfied.  Similarly,  if  either  q  or  p  and 
T  are  fixed,  then  it  suffices  for  E,  to  have  first  moments  to  satisfy 
the  covariance  condition  (2.1).  Later  when  we  shall  refer  to  stochastic 
programs  satisfying  a  weak  covariance  condition,  we  shall  always  assume 
that  its  random  elements  satisfy  (2.1)  or  some  other  condition  which  is 
weaker  than  (2.1),  but  would  be  sufficient  to  make  the  statement  valid. 

A  stochastic  programming  problem  with  fixed  recourse  can  be  formulated 
as: 


(2.2)  Find  inf  z(x)  -  E  { c(£)  x  +  Min  [q(c)y|  T(£)x  +  Wy  »  p(r)j} 
x>0  4 

Ax=b 


y>0 


where  A,  W,  and  b  are  fixed  matrices  of  size  m  x  n,  m  x  n,  and  m  x  1 
respectively,  and  denotes  expectation  with  respect  to  £.  We  speak 
here  of  fixed  recourse  by  opposition  to  the  case  when  the  matrix  W  is 
also  random.  This  more  general  case  has  been  discussed  in  [Walkup  and 
Wets,  1967-b]. 


Without  loss  of  generality,  we  can  assume  that  W  has  full  rank, 
since  otherwise  there  is  a  linear  non-singular  transformation  of  the 
system  of  equations  T(£)x  +  Wy  =  p(0  which  would  render  some  of  the 
rows  of  W  identically  zero;  in  which  case  the  corresponding  constraints 
either  generate  some  deterministic  restrictions  on  the  decision  variable 
x  which  could  have  been  included  in  the  constraints  Ax  *  b,  or  they 
constitute  a  genuine  system  of  stochastic  equations  whose  solution  depends 
non-trivially  on  £,  i.e.,  no  particular  vector  x  can  be  found  which 

would  satisfy  these  equations  with  probability  1.  In  this  last  eventuality, 
the  problem  would  be  infeasible. 

As  a  function  of  x  and  £,  which  we  shall  denote  by  Q(x,5)»  the 

problem  {Min  q(OylWy  53  p(£)  -  T(Ox}  might  be  infeasible  or  unbounded 
y>0 

below,  in  which  cases  we  shall  adopt  the  standard  conventions  and  define 
Q(x,£),  i.e.,  the  optimal  value  of  the  program  to  be  +®°  and  -“. 

Thus  the  integrand  of  (2.1)  might  vary  from  +°°  to  -®°  inclusively. 

Accordingly,  the  integral  E^{*}  ■  /  •  dp  is  defined  to  be  +°°,  if  the 
integrand  takes  on  the  value  +<*>  on  a  set  of  positive  measure.  It  is 
_oo  if  the  integrand  is  less  than  +<®  almost  everywhere  and  takes  on  the 
value  -«  on  a  set  of  positive  measure.  If  the  integrand  is  finite  almost 
everywhere,  it  corresponds  to  the  Lebesgues-Stieltjes  integral.  This  in¬ 
tegral  possesses  essentially  the  same  properties  as  the  standard  Lebesgues- 
Stieltjes  integral  except  that  subadditivity  replaces  the  usual 
additivity  property. 

Due  to  the  multistage  nature  of  (2.2)  it  has  been  traditional  and 
also  convenient  to  write  (2.2)  as  follows: 


Without  loss  of  generality,  we  can  assume  that  W  has  full  rank, 
since  otherwise  there  is  a  linear  non-singular  transformation  of  the 
system  of  equations  T(?)x  +  Wy  =  p(£)  which  would  render  some  of  the 
rows  of  W  identically  zero;  in  which  case  the  corresponding  constraints 
either  generate  some  deterministic  restrictions  on  the  decision  variable 
x  which  could  have  been  included  in  the  constraints  Ax  ®  b,  or  they 
constitute  a  genuine  system  of  stochastic  equations  whose  solution  depends 
non-trivially  on  £,  i.e.,  no  particular  vector  x  can  be  found  which 

would  satisfy  these  equations  with  probability  1.  In  this  last  eventuality, 
the  problem  would  be  infeasible. 

As  a  function  of  x  and  £,  which  we  shall  denote  by  Q(x,5)>  the 

problem  {Min  q(£)y|Wy  »  p(£)  -  T(Ox}  might  be  infeasible  or  unbounded 
y£0 

below,  in  which  cases  we  shall  adopt  the  standard  conventions  and  define 
Q(x,$),  i.e.,  the  optimal  value  of  the  program  to  be  +»  and 

Thus  the  integrand  of  (2.1)  might  vary  from  +°°  to  inclusively. 

Accordingly,  the  integral  E^{*}  «*  /  •  dy  is  defined  to  be  +00,  if  the 
integrand  takes  on  the  value  +°°  on  a  set  of  positive  measure.  It  is 

if  the  integrand  is  less  than  +»  almost  everywhere  and  takes  on  the 
value  -»  on  a  set  of  positive  measure.  If  the  integrand  is  finite  almost 
everywhere,  it  corresponds  to  the  Lebesgues-Stielt jes  integral.  This  in¬ 
tegral  possesses  essentially  the  same  properties  as  the  standard  Lebesgues- 
Stieltjes  integral  except  that  subadditivity  replaces  the  usual 
additivity  property. 

Due  to  the  multistage  nature  of  (2.2)  it  has  been  traditional  and 
also  convenient  to  write  (2.2)  as  follows: 
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(2.3)  Find  inf  z(x)  =  E^{c(5)x  +  Min  q(C)y} 

subject  to  Ax  =  b 

T(Ox  +  Wy  p(5)  a.e. 

x  >  0,  y  >  0 

where  it  is  understood  that  the  stochastic  constraints  T(Ox  +  Wy  =  p(£) 
must  be  satisfied  with  probability  1  (a.e.  denotes  almost  everywhere.) 

As  we  shall  see,  this  last  condition  follows  immediately  from  the  defini¬ 
tion  of  E^{*}.  From  a  theoretical  viewpoint  it  is  sometimes  convenient 
to  amalgamate  the  fixed  constraints  Ax  *  b,  x  >  0  and  the  stochastic 
constraints;  however,  for  practical  purposes  such  as  formulation  and 
computational  procedures  it  is  clearly  advantageous  to  separate  them. 

We  shall  follow  this  practice  here. 

Problem  (2.3)  can  be  seen  to  have  all  the  attributes  of  the  class 
of  stochastic  optimization  problems  described  in  the  introduction.  The 
sequential  nature  of  the  problem  [Dantzig,  1955,  Introduction]  is  clearly 
illustrated:  The  decision  process  involves  a  choice  of  a  decision  x, 
then  E,  occurs  and  is  observed;  finally  a  recourse  action  y  is  selected 
so  as  to  satisfy  the  stochastic  constraints.  Since  the  decision  y  is 
completely  determined  by  the  selection  of  a  given  x  and  the  occurrence 
of  some  £,  the  only  real  decision  is  the  choice  of  x.  The  actual  value 
of  the  decision  is  determined  as  soon  as  x  and  t,  are  known,  even 
though  determining  this  value  involves  solving  a  linear  program;  the  structure 
of  the  problem  determines  this  value  uniquely.  The  attitude  towards  risk 
of  the  decision  maker  is  reflected  by  the  linearity  of  the  objective,  i.e., 


f  VM  ?  'MP  'f  v-4 
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it  indicates  neither  risk  aversion  nor  risk  seeking.  Finally,  the 
definition  itself  of  the  problem  guarantees  that  one  has  all  the 
necessary  information  concerning  the  random  elements  of  the  problem. 


3.  The  Deterministic  Equivalent  Program.  As  mentioned  in  the  intro¬ 
duction,  the  purpose  of  the  first  part  of  this  survey  is  to  characterize 
the  so-called  deterministic  equivalent  program  of  problem  (2.2).  Let 

z(x,£)  =  c(C)x  +  Q(x,£) 


then 

(3.1)  z(x)  =  E^{z(x,c)}  =  E^{c(Ox  +  Q(x,0}  =  cx  +  Q(x) 

where  c  the  expectation  of  c(5)  is  finite,  since  assumption  (2.1)  implies  that 
all  the  components  of  £  are  integrable.  Also,  in  view  of  the  definition 
of  the  function  Q(x,£)  and  the  integral,  the  functions  z(x)  and  Q(x) 
are  well  defined  for  all  x  in  Rn  as  functions  with  range  in  the  extended 
reals,  provided  Q(x,£)  is  measurable.  This  is  fairly  easy  to  prove,  see  e.g., 
[Kail,  1967,  Section  1,  Satz  1]  or  [Walkup  and  Wets,  1967-b,  Lemma  (2.3)]. 

Note  that  among  other  things,  it  is  possible  for  Q(x)  and  thus  z(x)  to  be 
identically  +«>  or  take  on  only  the  values  +°°  and  -».  The  problem 

(3.2)  Find  inf  z(x)  =  cx  +  Q(x) 

Ax  =  b 
x  >  0 


is  known  as  the 


ilcteministi a  equivalent  preqrari  of  a  stochastic  program 


with  recourse. 


Later  on  we  shall  give  a  more  detailed  form  of  the 
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detenninistic  equivalent  program,  but  before  we  do  so,  we  need  to  probe 
somewhat  deeper  into  the  particularities  of  the  function  Q(x).  The 
next  section  is  essentially  devoted  to  the  description  of  the  region  of 
finiteness  of  Q(x).  The  properties  that  Q(x)  possess  on  this  set 
receive  further  elaboration  in  Section  7. 

4.  Feasibility  Region.  The  feasibility  region  of  a  mathematical  program 
is  usually  defined  to  be  the  set  of  points  satisfying  the  constraints.  One 
can  also  define  the  feasibility  region  as  the  set  of  those  points  at  which 
the  objective  is  less  than  -H»  accepting  implicitly  the  convention  that 
the  objective  is  +°°  outside  the  set  determined  by  the  constraints.  In 
most  practical  situations  these  two  definitions  are  equivalent.  That 
this  is  also  the  case,  for  the  class  of  problems  under  consideration, 
does  not  follow — as  is  usual — from  the  definition  of  the  problem.  In 
fact,  the  notion  of  feasibility  is  a  very  touchy  problem,  especially 
because  the  more  natural  definitions  of  feasibility  do  not  seem  to  yield 
any  grip  on  the  computational  aspects  of  the  problem,  whereas  a  more 
constructive  type  of  definition  seems  to  be  a  little  too  restrictive. 

In  the  first  papers  dealing  with  stochastic  programming  this  problem 
did  not  arise,  because  the  models  considered  were  such  that  some  assumption, 
stated  explicitly  or  present  implicitly,  eliminated  this  question.  Let 

Kj  «  { x ) Ax  *  b ,  x  t  0} 

be  the  set  determined  by  the  fixed  constraints  of  the  problem.  If  we 
assume  relatively  complete  recourse,  i.e,,  for  all  x  in  Kj  there  always 


A 
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exists  some  y  >  0  such  that  Wy  »  p(0  -  T(£)x  for  every  £  in  RN, 
then  obviously  the  feasibility  region  is  determined  by  Kj  alone.  One 
can  verify  that  the  models  considered  by  [Beale,  1955],  [Dantzig,  1955], 
[Dantzig  and  Madansky,  1961],  [Williams,  1963],  [Williams,  1965],  [Wets, 
1966-a],  and  [El-Agizy,  1967],  to  name  but  a  few,  all  implied  relatively 
complete  recourse.  This  assumption  limits  somewhat  arbitrarily  the  range 
of  possible  applications,  especially  with  respect  to  production  models; 
and  even  though  in  most  cases  its  verification  might  be  easy,  in  general 
this  might  not  be  the  case.  During  the  last  five  or  six  years  a  certain 
number  of  papers  [Wets,  1966-b],  [Kali,  1967],  [Dempster,  1968],  and 
[Parrikh,  1967],  to  again  mention  only  a  few,  started  with  approaching 
the  problem  of  (i)  establishing  criteria  for  determining  when  the  assump¬ 
tion  of  relatively  complete  recourse  is  satisfied,  as  well  as  (ii)  con¬ 
sidering  a  more  general  model  for  stochastic  programming  where  this 
undesirable  restriction  has  been  removed.  In  Section  6,  we  shall  discuss 
the  problem  of  verifying  the  assumption  of  relatively  complete  recourse, 
as  well  as  some  related  questions.  For  the  time  being  we  restrict  our¬ 
selves  to  the  problem  we  have  defined  and  characterize  as  completely  as 
possible  its  region  of  feasibility. 

As  indicated  above,  we  can  define  the  feasibility  set  as  the  inter¬ 
section  of  the  set  determined  by  the  fixed  constraints  K1  and  a  set 
K2  determined  by  the  induced  constraints  generated  by  the  stochastic 
constraints.  We  consider  the  following  three  candidates  for  K2: 
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(i)  k)}  =  {x  |  with  probability  1  3  y  1  0  such  that  Wy  =  p(£)  -  T(£)x} 

*  {x  |  Q(x,£)  *  +»  with  probability  zero} 

That  these  two  definitions  of  are  equivalent  follows  immediately  from 

the  -H®  and  -°°  conventions  we  have  adopted  for  the  definition  of  the 
function  Q(x,0- 

(ii)  K®  -  {x  |  Q(x)  <  +«} 

This  set  is  known  as  the  strong  feasibility  set  since  it  clearly  defines 
the  region  of  finiteness  of  Q(x)  (unless  Q(x)  takes  on  the  value  -°°) . 

These  two  first  definitions  of  feasibility  seem  to  lead  to  natural 
interpretations  from  a  mathematical  viewpoint  as  well  as  from  an  economic 
standpoint.  The  third  definition 

(iii)  Kj  *  {x | VC  e  E,  3y  1  0  such  that  Wy  -  p(0  -  T(£)x} 

can  be  viewed  as  requiring  that  the  stochastic  constraints  be  satisfied 
for  all  points  of  the  random  elements  which  are  "possible"  where  possible 
is  defined  as  those  points  lying  in  the  support  of  the  distribution 
of  £.  As  we  shall  see,  this  last  definition  allows  for  a  more  con¬ 
structive  approach  to  the  description  of  the  feasibility  region,  but  from 
a  purely  mathematical  viewpoint  this  "possibility"  interpretation  of  the 
stochastic  constraints  is  not  as  gratifying  as  the  probabilistic  inter¬ 
pretation  associated  with  the  first  two  definitions. 

Although  the  following  is  not  the  case  in  general  [Walkup  and  Wets,  1967-b], 
for  the  problem  at  hand,  we  have  that: 
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Theorem  (4.1).  For  a  stochastic  program  with  fixed  recourse  where 
C  satisfies  a  weak  covariance  condition,  such  as  condition  (2.1),  the 
relation 

(4.2)  k!J  =  K?P  =  K® 
holds. 

'"w 

Proof •  Since  ~  is  some  set  of  probability  1,  it  follows  that 

P  y 

K2  C  K^,  Thus  to  prove  the  first  part  of  the  theorem  it  suffices  to 
show  inclusion  in  the  other  direction.  The  following  notation  has  proved 
to  be  very  useful  for  problems  of  this  type.  Let 

(4.3)  pos  W  *  {tjt  *  Wy,  y^Oj 

be  the  positive  hull  spanned  by  the  columns  of  W,  i.e.,  the  closed 

convex  cone  with  apex  at  the  origin  generated  positively  by  the  points  of  Rm 

corresponding  to  the  columns  of  W.  Thus,  we  can  write 

b  { x | p ( C)  -  T(4)x  e  pos  W  with  probability  l} 

and 

K?  =  {xjp(0  -  T(;)x  t*  pos  W  for  all  in  zj 

If  x  c  Kj  then  poe  W  contains  a  set,  say  \  ,  of  measure  1  with 
respect  to  the  measure  induced  by  the  random  vector  ?  («•)  *  p(C)  ~  T(^)x. 
Since  pos  W  is  closed,  the  closure  of  A  is  also  contained  in  pos  W 
and  at  fortiori  so  is  the  suppport  of  >\.(').  Since  i  is  a  linear 

function  of  i  (by  definition  p(r)  and  T(')  .ire  canonical  projections 
of  ■.)  it  follows  that  and  the  closure  of  I^(  )  coincide, 


i.e.  , 


x  c  KP. 


Thus  Kl;  =  KP. 
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To  show  the  remaining  equality  we  first  observe  that  the  inclusion 

holds  trivially  from  the  definition  of  the  integral.  Since 
K2  »  K2  and  S  has  measure  1,  there  remains  only  to  be  shown  that  for 
every  x  in 

Q(x)  *  J^Q(x,C)dy  <  +“. 

Let  {w^}  be  a  subcollection  of  the  square  non-singular  submatrices 
of  W  of  rank  m,  such  that  the  {w^}  are  distinct  and  such  that 
{pos  W^}  constitutes  a  covering  of  pos  W.  Let  q(C)^  denote  the 
subvector  of  q(£)  corresponding  to  the  columns  of  W  determining  . 

For  every  x  in  and  every  £  in  5,  p(£)  -  T(g)x  belongs  to  some 

P°a  ^(1)  and  since  determines  a  feasible  but  not  necessarily  optimal 

basic  solution  for  the  recourse  problem  whose  right-hand  side  is 
d(0  -  T(Ox,  we  have  that 

Q(x» 0  -  q(0 [p(c)'T(C)x3  *  v(1)(x»c)* 

The  integral  is  isotone,  thus 

■4(i)(x,Q<x’«>d"  -  i=(1)(x)'’(i)(x'«)d'* 

where  5^(x)  *  {$|p(£)  -  T(^)x  c  pos  The  right-hand  side 

of  this  inequality  is  finite,  since  S  satisfies  the  covariance  condition 
(2.1).  Let  2(j\(x)}  be  a  finite  partition  of  E,  where  each  (x) 

is  obtained  from  the  finite  collection  {s^(x)  D  If}  by  a  finite  number 
of  set  theoretic  operations  (intersections,  set  differences).  That  such 
a  partition  exists  follows  from  the  fact  that  x  e  implies  that 


/  • 
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(x)  D  E.  Now,  define  v^(x,£)  on  Z^(x) 

v(j)(x,£)  *  Max{v(i)(x,OU  e  E(i)(x)  n  I(j) 


as  follows 
(x)} . 


Then 


Q(x)  =  f  Q(x,Odu  *  1  f  Q(x,Odu  -  1  J  v  (x.Ody. 

-  (J)  Z(j)(x)  (J)  Z(j)(x) 

The  last  member  of  this  inequality  is  a  finite  sum  of  finite  terms,  from 
which  it  follows  that  Q^x)  is  bounded  above.  Thus  which 

completes  the  proof. 


The  first  equality  in  (4.2)  extends  to  the  case  where  W  is  also 
random  [Walkup  and  Wets,  1967-b]  provided  one  requires  that  the  restriction 

<N* 

of  pos  W(£)  to  E  is  continuous,  where  pos  W(0  is  viewed  as  a  map 
from  E  C  {^+(r-XIn)  into  a  metric  space  (£?, d)  whose  points  are  convex 
cones  with  apex  at  the  origin  and  the  metric  d  is  determined  by  the 
Hausdorff  distance  between  their  intersections  with  the  unit  ball  [Walkup 
and  ’..ets,  1967-a].  However,  when  W  is  random,  there  seems  to 
be  no  easily  verifiable  condition  which  one  could  impose  on  so  as  to 
insure  that  the  second  equality  in  (4.2)  also  remains  valid. 


From  the  definition  of  the  problem  (2.2),  it  is  easy  to  see  that  feasi¬ 
bility  depends  only  on  the  p,  T  components  of  t,.  Thus  if  we  let 

~  y 

::  be  the  projection  of  E  on  the  p,T  coordinates  of  R  ,  we  have 

P  >  l 

that 

k?  =  n  mo  =  n  MO 

_  T 
(*  !  1 

where 


(4.4) 


K0  ( £,)  =  { x |  p( c)  -  T(  ,)x  c  pos  Wf  |x;Q(x,  ‘)  ■  +'f. 


X-SMKV*.  -  ■ 


* 
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By  arguments  similar  to  those  used  in  the  first  part  of  the  proof 

of  theorem  (4.1),  one  can  show  that  K,  **  fi_  --  K.(£)  where  5  T  is  the 

*  T  z  P>L 

P  i* 

support  of  the  marginal  distribution  of  (p(£),T(£)). 

Corollary  (4.5).  For  a  stochastic  program  with  fixed  recourse,  where 

i 

£  satisfies  a  weak  covariance  condition,  such  as  (2.1),  the  relation 


holds,  where 

K2«  f|  K_(0  =*  {x|p(4)-T(5)x  e  pos  W  for  all  (p(S),T(4))  in  S  } 
Ce?p,T  2  P»T 

In  view  of  the  preceding  corollary,  we  shall  write  K2  whenever  we 

want  to  refer  to  a  set  of  constraints  induced  on  x  by  the  stochastic 

constraints  of  problem  (2.3):  T(£)x  +  Wy  =  p(£)  a.e.  This  set  K2 

possesses  various  interesting  properties  which  we  investigate  in  the 

remainder  of  this  section. 

Theorem  (4.6).  Let  Z  be  a  set  obtained  from  5  by  applying  the 

P » l 

operations:  topological  closure,  convex  closure,  positive  closure, 
positive  scalar  multiplication,  or  any  of  the  (not  necessarily  unique) 
inverses  of  these  operations,  then 

-  n  k2u>. 

C.C  Z 

(The  inverse  operation  of  convex  closure  yields  the  extreme  points.) 


I 


0 


1 


Proof.  Suppose  K2  =  fl  K2(0,  then  the  fact  that  pos  W  is  closed 

£el' 

justifies  replacing  I'  either  by  its  closure  or  by  a  dense  subset  of 
£'  in  the  definition  of  K2.  The  remaining  assertions  of  the  theorem 
follow  rather  directly  from  the  fact  that  pos  W  is  a  convex  cone  and 
the  definition  of  K?(£)  given  by  (4.4). 


i  ,  ^  •*“  !•*  '  ^  f 1 


1 
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Theorem  (4.7).  The  feasibility  region  K2  is  a  closed  convex  subset 

of  Rn.  Moreover  if  the  closed  positive  hull  of  E^  written 

pos  (E  ),  is  a  convex  polyhedral  cone,  then  K,  is  a  convex  poly¬ 
pi  z 

he dr on. 

Proof.  Since  K-  *  n  K-(z;),  the  first  part  of  the  theorem  follows 

'  "  ■"  £-  £ 

trivially  from  the  p*  observation  that  for  each  c,  K  (?)  is 


a  closed  convex  polyhedron.  The  second  part  follows  from  theorem  (4.6) 

since  in  this  case  we  may  replace  E  T  C  R^n+1^m  by  a  finite  set, 

P  >  1 

namely  by  any  set  of  points  whose  positive  combinations  span  pos(E  T) , 
This  set  of  points  can  be  chosen  finite  by  (4.6)  since  by  assumption 
pos(*=  )  is  a  polyhedron  and  thus  has  only  a  finite  number  of  extremal 
elements.  (Note  that  there  are  other  cases  for  which  K2  is  polyhedral, 
e.g.,  if  pos  W  *  Rm,  then  K2  =  Rn.) 


Note  that  since  we  are  dealing  with  finite  dimensional  real  vector 

spaces,  which  have  the  Lindelof  property,  it  follows  that  K2  can  always 

be  represented  as  the  intersection  of  at  most  a  countable  subcollection 

of  sets  K„(?).  Also  in  view  of  theorem  (4.6),  the  assumption  that  pos(E  _,) 

^  P  *  1 

is  polyhedral  is  probably  the  most  general  type  of  assumption  which  yields 

an  easy  proof  that  K,  is  polyhedral.  In  practice  one  might  expect  that 

very  few  cases  wil]  occur  when  pos(E  )  will  not  be  polyhediel  since 

P » 1 

*** 

pos(E  )  is  polyhedral  if  the  components  of  p  and  T  are  independent, 

P » 

if  p  and  T  have  a  finite  discrete  distribution,  if  the  convex  hull 
*>»* 

of  E  is  polyhedral,  etc.  There  is  however  one  other  interesting 
case  in  which  one  is  able  to  prove  that  K-,  is  polyhedral. 


Before  we  consider  this,  we  introduce  a  concept  very  useful  in  the 
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theory  of  convex  polyhedra  in  general  and  stochastic  programming  theory 
in  particular.  We  first  give  a  precise  meaning  to  the  notion  of  extremal 
elements  of  a  convex  cone. 

Definition  (A. 8).  Let  A  be  a  matrix  of  row  size  m.  The  columns 

of  A  can  be  thought  of  as  points  in  Rm.  Then  a  subset  of  the  columns 

of  A,  say  T,  constitutes  a  frame  for  the  positive  hull  of  A  if 

1c 

pos  A  =  pos  T  and  T  is  minimal,  i.e.,  for  every  column  T  of  T 

k 

we  have  that  pos  (T~T  )  ^  pos  T. 

Simple  examples  will  show  that  a  set  of  points  in  Rm  might  contain 
more  than  one  frame  and  that  two  different  frames  do  not  necessarily  have 
the  same  cardinality.  Naturally,  every  finite  set  of  points  in  Rm  con¬ 
tains  a  finite  frame. 

Definition  (A. 9) .  The  matrix  A*  is  a  polar  matrix  of  A  if 

(i)  pos  A  =  { t | A*t  i  0} 

(ii)  The  rows  of  A*  constitute  a  frame  of  the  polar  cone 

pos*  A  of  pos  A,  where  pos*  A  3  { t | t t  £  0  for  all  t  e  pos  A}. 

Similarly,  one  could  define  the  polar  matrix  of  A  as  a  matrix  whose 
rows  determine  a  set  of  minimal  supports  for  the  convex  polyhedral  cone 
generated  by  the  points  represented  by  the  columns  of  A.  In  some  sense, 
the  polar  matrix  is  a  positive  inverse  of  W,  The  notion  of  polar  matrix 
was  first  introduced  in  [Wets,  1966-c]  in  connection  with  the  first  proof 
of  theorem  (4.10)  below.  A  similar  concept,  but  used  in  a  different 
context,  can  also  be  found  in  the  work  of  Fulkerson  [Fulkerson,  1968). 
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He  uses  the  name  of  blocking  matrix. 

In  general,  the  number  of  rows  of  A*  is  not  commensurate  with  the 
numbers  of  columns  of  A.  In  particular  A*  might  have  no  rows,  which 
corresponds  to  the  case  when  pos  A  has  no  supports,  i.e.,  when 
pos  A  =  Rm.  On  the  other  hand,  if  pos  A  is  a  cone  over  a  neighborly  polytope 
[Griinbaum,  1967;  Chap.  7],  then  pos  A  might  contain  an  extremely  large  number 
of  rows  when  compared  with  the  number  of  columns  of  A.  Various  efforts 
have  been  made  to  relate  the  generalized  inverse  of  a  matrix  A  to  the 
polar  matrix  of  A.  So  far  none  of  these  attempts  have  been  remunerated 
by  success.  One  might  reasonably  expect  that  no  interesting  relation  does 
exist,  [Wets,  1968]. 

Theorem  (4.10).  Suppose  T  is  fixed  in  the  stochastic  program  (2.2) 
and  £  satisfies  a  weak  covariance  condition,  then  K2  is  a  closed  convex 
polyhedron. 

Proof.  Since  T  is  fixed,  by  corollary  (4.5)  x  e  K2  if  and  only 

if  (p(S)“Tx)  e  pos  W  for  all  p(£)  in  E  where  T  is  the  support 

P  P 

of  the  distribution  of  p(5).  Now  (p(0“Tx)  e  pos  W  if  and  only  if 
W*(p(0-Tx)  5  0.  Thus  x  e  K2  if  and  only  if  (W*T)x  >  W*p(£)  for 
all  p(§)  in  Ep  or,  by  theorem  (4.6),  for  all  p(£)  in  Z  where  Z 
is  the  closed  convex  hull  of  Tp.  This  possibly  infinite  system  of 
linear  inequalities  can  be  replaced  by 

(4.11)  (W*T),x  >  a*  -  Sup  w*p (0  i  -  1 . 1 

P(0el  1 

where  WJ  denotes  the  it^1  row  of  the  matrix  W*  and  Z  is  the  number  of 
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rows  of  the  matrix  W*.  Unless  a*  <  +°°  for  all  i  =  1,...,£  the 
problem  is  infeasible  in  which  case  K  =  0  and  the  theorem  holds 
trivially,  otherwise  the  system  (4.11)  constitutes  a  finite  system  of 
linear  constraints  which  determine  the  polyhedron 

(4.12)  K2  -  {x|  (W*T)x  >  ct*} 

where  a*  is  the  vector  whose  components  are  a*. 

Corollary  (4.13).  If  p(0  and  T(0  are  independent  and  ET  (or 
the  closure  of  its  positive  hull)  is  polyhedral,  then  K2  is  polyhedral. 

Proof.  Since  p(£)  and  T(0  are  independent  E^  ^  =  E^  x  E^.  For 
each  T(£)  in  E^,,  let  K2(T(£))  denote  the  set  of  x's  such  that 

[W*TU)  ] x  >  a* 

Now  K2  -  Q  k2(q  -  n^K2  (T(0)»  Since  S  is  polyhedral,  by 
4E=p,T  T(C)£=t  ^ 

theorem  (4.6)  we  may  replace 

seating  the  extremal  elements  of  Ep»  Thus  K2  can  be  written  as  a 

finite  intersection  of  polyhedra  K2(T(0)» 

So  far  we  have  shown  that  the  region  of  feasibility  of  a  stochastic 
program  with  fixed  recourse,  i.e.,  the  set 

K  -  Kj  OK2 

is  a  set  possessing  fairly  interesting  properties.  It  is  always  closed  and 
convex  and  under  fairly  general  assumptions  it  is  even  polyhedral.  When  T 


in 


T(Qe 


O  ~  by 


a  finite  set  repre- 


is 


fixed,  we  have  also  seen  that  x  e  K  if  and  only  if 


x  satisfies  some 
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deterministic  linear  constraints  (4.12)  where  a*  represents  in  some 
sense  a  lower  bound  of  the  set  5^,.  Determining  such  a  lower  bound — 
especially  if  it  is  easy  to  compute — might  be  very  useful  in  obtaining 
criteria  of  feasibility  as  well  as  for  constructing  algorithmic  procedures 
generating  feasible  solutions.  In  this  pursuit  it  is  convenient  to  intro¬ 
duce  some  terminology  related  to  convex  cone  ordering  of  real  vector 
spaces.  This  approach  was  first  presented  in  some  lectures  given  at  the 
University  of  California  [Wets,  1967].  In  his  doctoral  dissertation  [Parrikh, 
1967]  Parrikh  shows  that  these  ideas  can  also  be  fruitfully  exploited  in  a 
slightly  different  setting. 

Definition  (4.14).  The  partial  ordering  is  said  to  be  a  cone 
ordering  induced  by  a  closed  convex  cone  C  C  Rm  if 

x  y  is  equivalent  to  y  -  x  e  C 

We  need  the  following  obvious  property  of  cone  orderings: 

Proposition  (4.15).  Let  denote  the  cone  ordering  induced  by  the 

closed  convex  cone  C,  and  let  denote  the  cone  ordering  induced 

by  the  closed  convex  cone  C2 .  Then 

x*c  z  implies  x-\fc  +c z 

where  Cj  +  C?  denotes  the  vector  sum  of  Cj  and  C2 .  In  particular 
if  Cj  3  c ,  then 

x^$  r  V-v>  2  implies  x^_  z 
Cj  '  02  C1 
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Definitions  (4.16).  Let  Z  be  a  subset  of  Rm  and  ^  a  cone  ordering 
induced  by  C.  A  point  ac  is  said  to  be  a  gvec.test  looer  bound  of  Z 
with  respect  to  the  ordering  induced  by  the  cone  C  if  a  %  a  for 

c  c 

all  points  a  satisfying  a  for  all  ?  in  Z. 

Moreover  if  a^,  also  belongs  to  the  closure  of  Z,  then  ot^  is  said  to 
be  a  proper  louer  bound  of  Z. 

Theorem  (4.17).  Consider  a  stochastic  program  with  fixed  recourse  whose 
random  elements  satisfy  a  weak  covariance  condition.  Let  C  be  a  closed 
convex  cone  contained  in  pos  W,  A(x)  *  {p(0  -  T(£)x|  p(C)»T(£)eE  _} 
and  a„(x)  is  a  proper  lower  bound  of  A(x).  Then  x  e  K  if  and  only 

v/  4 

if  ac(x)  e  pos  W. 

Proof.  By  theorem  (A. 6),  x  c  K?  if  and  only  if  the  closed  set 
A(x)  C  pos  W.  The  rest  of  the  proof  follows  from  the  last  part  of 
proposition  (4.15)  since  by  assumption  C  C  pos  W. 

Corollary  (4.18).  Suppose  T  is  fixed  in  a  stochastic  program  with 

fixed  recourse  whose  random  elements  satisfy  a  weak  covariance  condition. 

Suppose  C  is  a  closed  convex  cone  contained  in  pos  W  and  ot^,  is  a 

proper  lower  bound  of  Then  x  c  K2  if  and  only  if 

a c(x)  *  ac  -  Tx  t  pos  W.  In  particular,  x  e  K2  if  and  only  if 

apos  W-Txe  Pos  W»  w^ere  otp os  ItT  is  a  proper  lower  bound  of 

with  respect  to  ^  .  Moreover,  a  „  *  u*  where  a*  is  as 

pos  w  pos  W 


defined  by  (4.11). 
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The  first  part  of  the  corollary  is  an  immediate  consequence  of 
the  theorem  and  the  equality  ct*  =  apog  y  follows  directly  from  their 
respective  definitions. 

Provided  that  a  proper  lower  bound  exists,  the  usefulness  of  the  above 
characterizations  is  only  limited  by  our  capability  of  computing  it.  When  T 
is  fixed,  one  way  to  determine  this  proper  lower  bound  is  to  compute  W*.  This 
might  be  by  itself  a  major  undertaking  which  we  shall  discuss  further 
in  the  following  section.  In  practice,  finding  such  a  lower  bound  reduces 
down  to  finding  some  cone  C  contained  in  pos  W  such  that  the  proper 
lower  bound, with  respect  to  the  ordering  induced  by  C ,  of  any  subset  in 
R1"  is  fairly  easy  to  compute.  This  will  certainly  be  the  case  if  C 
can  be  selected  to  be  some  orthant.  If  a  lower  bound  of  ?  with 

P  »T 

respect  to  some  orthant  is  also  a  proper  lower  bound,  then  by  theorem 
(4.17)  and  its  corollary,  verifying  feasibility  of  any  given  x  is  a 
fairly  easy  task.  We  shall  devote  a  fair  portion  of  the  subsequent 
developments  to  the  case  when  pos  W  contains  some  orthant.  Moreover, 

the  following  proposition  helps  justify  the  relative  importance  we  attach 
to  this  case. 

Proposition  (4.19)_.  ^  Let  «c  be  a  cone  ordering  on  R™.  Then  every 
bounded  subset  of  Rm  has  a  unique  greatest  lower  bound  if  and  only  if 

the  cone  C  is  the  positive  orthant  with  respect  to  some  coordinate 
system. 

Proof.  The  if  condition  is  obvious.  To  prove  the  only  if  conditions 
we  make  use  of  Choquet’s  characterizations  of  simplices  in  terms  of 
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homothetic  intersections.  Suppose  every  bounded  subset  of  Rm  has  a 
unique  greatest  lower  bound  with  respect  to  It  is  easy  to  verify 

that  uniqueness  implies  that  C  must  be  a  pointed  cone  and  that  the 

existence  of  lower  bounds  for  full  dimensional  subsets  of  Rm  implies 
that  C  has  dimension  m.  Let  H  be  some  hyperplane  supporting  C 

at  the  origin  only,  H+  the  closed  half-space  bounded  by  H  which  contains 

c  c 

C,  H+  the  complement  of  H+  and  a  in  H+  the  unit  normal  to  H. 

Let  s  and  t  be  any  two  distinct  points  of  h£,  then  Pg  *  (s+C)  O  H  ^ 

and  Pt  *  (t+C)  n  h£  are  homothetic,  with  s  and  t  greatest  lower  bounds 

for  P  and  P  respectively.  Suppose  Q  =  P  O  P  4  0.  By  the 

St  s  t 

c 

hypotheses  Q  has  a  greatest  lower  bound  q  and  thus  (q+C)  O  Hj.=  P^  3  Q, 

Since  P  D  Q,  s  is  a  lower  bound  for  Q  and  s  ^ r  q.  Thus  P  DP 

S  L  S  (J 

and  similarly  P  DP  so  that  P  D  Q  *  P  H  p  DP,  i.e. ,  P  H  P  =  P  . 

tq  q  tsq  stq 

Thus  any  homothets  of  the  closed  bounded  figure  P^  intersect  either  in 
a  point,  a  homothet  of  P  or  the  empty  set.  By  Choquet's  characterization 
[Choquet,  1956] — for  a  simple  proof  see  [Eggleston,  GrUnbaum  and  Klee, 

1964] — P^  must  be  a  simplex.  Since  C  has  full  dimension,  it  follows 
that  C  is  a  simplicial  cone  which  is  linearly  isomorphic  to  the  positive 
orthant  of  Rm. 

Theorems  (4.7),  (4.10)  and  (4.17)  and  their  corollaries  summarize 
the  most  useful  characterization  of  the  feasibility  region  K2  which  are 
so  far  available.  Among  other  things  they  allow  us  to  rewrite  the  deter¬ 
ministic  equivalent  program  as 


■=  ?  -sgtyscggy  <"*  "w*"**^ 
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(4.20)  Find  inf  z(x)  =  cx  +  Q(x) 

subject  to  Ax  *  b 

(W*T(0)x  >  W*p(;)  for  all  x,  in  ?  _ 

VtL 

x  >  0 

where  the  function  Q(x)  is  finite  on  the  set  determined  by  the  con¬ 
straints  unless,  as  we  shall  see,  it  is  identically  -°°  on  this  set.  If 

the  structure  of  E  allows  us  to  use  some  of  the  preceding  results, 

P  >  1 

then  even  more  practically  oriented  expressions  can  be  found  for  the 

deterministic  equivalent  problem.  For  example,  if  T  is  fixed,  then 

one  can  write  (4.20)  as 

(4.21)  Find  inf  z(x)  *  cx  +  Q(x) 

Ax  *  b 

(W*T) x  '  a* 

x  =0 

where  i*  is  defined  by  (4.11). 

5.  Finding  a  Feasible  Solution.  In  the  first  part  of  this  section, 
we  outline  some  very  general  ideas  which  can  be  used  to  find  a  feasible 
solution.  These  neeessnrv  concepts  are  summarized  in  the  algorithm  (5.5) 
and  its  variants  described  below.  So  much  will  depend  on  the  particular 
structure  or  the  particular  way  the  entities  involved  are  given  that  in  fact 
t  is  impossible  to  find  a  unique  "best"  procedure.  The  algorithms  that  we 
describe  should  be  viewed  as  possible  skeletons  rather  than  finished  products. 
In  the  second  part  of  this  section  we  deal  with  some  specific  cases  which 
allow  for  very  effective  solution  procedures. 

The  results  derived  in  the  first  part  of  this  section  were  obtained  in 
collaboration  with  I).  Walkup, 
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Determining  whether  a  point  x  belongs  to  Kj  reduces  to  checking 
if  it  satisfies  a  system  of  linear  inequalities.  We  consider  this  problem 
solved  and  thus  limit  ourselves  to  the  case  of  finding  a  point  of  K2. 

In  the  preceding  section  we  have  obtained  various  characterizations  of  the 
set  K2#  In  general,  i.e.,  when  the  support  of  the  distribution  or  the 
matrix  W  have  no  special  properties ,  determining  if  a  given  x  is  in 
K2  is  equivalent  to  determining  if 

A(x)  *  {t  1 1  =  p(?)  -  T(Ox,  (pU).T(O)  e  1} 

is  or  is  not  contained  in  the  convex  polyhedral  cone  pos  W,  where  I 
is  a  set  obtained  from  5^  ^  by  any  one  of  the  operations  mentioned  in 
theorem  (4.6).  If  I  is  a  convex  set  (polyhedron)  so  is  A(x).  Thus 
in  general  determining  if  a  given  x  is  feasible  comprehends  the  problem 
of  determining  when  a  convex  set  is  contained  in  a  convex  polyhedral  cone. 
Depending  on  the  manner  in  which  the  set  A(x)  is  given,  this  problem 
might  turn  out  to  be  fairly  easy  or  extremely  difficult.  If  the  set 
A(x)  is  finite  or  more  generally  if  its  convex  hull  has  only  a  finite 
number  of  extreme  elements  (extreme  rays  and  extreme  points)  [Klee,  1957] 
which  can  be  easily  determined,  then  it  is  not  very  difficult  to  determine 
if  A(x)  C  pos  W,  since  this  involves  at  most  solving  a  finite  number  of 
linear  programs  which  differ  only  in  their  right-hand  sides,  namely, 

+  , 

es  +  es 

Wy  +  Is+  -  Is"  =  6^  . 

(x) 

y  >  0,  s+  >  0,  s"  >  0 


(5.1) 


Minimize  w  = 


where 


e  is  a  row  vector  of  size  m  whose  components  are  l's  and 


6^^,  k  =  l,...,t  are  the  extremal  elements  of  the  convex  hull  of 

A(x).  Various  tricks  are  available  which  allow  for  considerable 

simplification  and  the  work  involved  is  by  no  means  to  be  equated  with 

solving  t  linear  programs  [Van  Slyke  and  Wets,  1969,  Section  5]. 

Although  in  general  finding  the  extremal  elements  of  A(x)  might  prove 

to  be  a  real  challenge,  in  some  particular  cases  this  might  not  prove  to 

be  very  difficult,  e.g.,  if  the  components  of  T(£)  and  p(£)  are 

independent,  then  the  extremal  elements  of  A(x)  can  be  obtained  by  paying 

attention  only  to  the  extremal  elements  of  T  T  which  in  this  case  is 

-  P*1 

a  rectangle  (possibly  unbounded)  in  R  .If  either  A(x)  (or 

its  convex  hull)  is  only  available  in  terms  of  the  bounding  hyperplanes 
of  the  set  or  when  A(x)  is  not  even  polyhedral,  then  one  would  have  to 
resort  to  a  technique  somewhat  similar  to  the  one  described  below. 


Feasibility  Criterion  (5.2).  Consider  a  stochastic  program  with  fixed 
recourse  whose  random  elements  satisfy  a  weak  covariance  condition.  A 
vector  x  in  Kj  is  a  feasible  solution  if  and  only  if  the  optimal 
value  of  each  of  the  l  convex  programs 

(5.3)  Find  inf  w  =  W*(Tx-p) 

(p»T) 

subject  to  (p,T)  c  I 

is  greater  than  or  equal  to  zero,  wnere  W*  is  the  k^1  row  of  W*  the 
polar  matrix  of  W,  i  is  the  number  of  rows  of  W*  and  E  is  the  closed 
convex  hull  of  •: 

p.r 


This  feasibility  criterion  is  nothing  more  than  a  reformulation  of 
the  induced  constraints  found  in  the  deterministic  equivalent  program 
(4.20).  The  following  proposition  provides  a  method  for  "improving" 
an  infeasible  solution.  In  fact,  the  proposition  shows  how  one  can 
generate  bounding  hyperplanes  of  the  set  K2. 


Proposition  (5.4).  Consider  a  stochastic  program  with  fixed  recourse 

whose  random  elements  satisfy  a  weak  covariance  condition  •  Suppose  E  is  a 

set  obtained  from  H  by  topological,  convex  or  positive  closure  and 

P  i  * 

x  is  any  point  in  Rn.  If  (p,T)  is  a  point  of  £  such  that 
W*(Tx-p)  <  0  then  either 


{ x | (W*T)x  >  W*p} 

is  empty  or  is  a  closed  halfspace  in  Rn  containing  K2  but  not  x. 

If  (p,T)  and  (p',T')  are  points  in  gm(n+1)  such  that  for  all 
sufficiently  large  positive  A,  (,p\t^)  =  (p,T)  +  A(p,,T>)  is  a  member 
of  I  and  W*(T^x-p^)  is  unbounded  below  as  A  -*•  +°°,  then  either 

{ x | (W*T’ ) x  >  W*p'} 

is  empty  or  a  closed  halfspace  in  Rn  containing  K2  but  not  x. 


Proof.  The  first  part  follows  directly  from  the  feasibility  criterion 
(5.2).  For  the  second  part  if  W*(T^x-pS  *  W*(Tx-p)  +  AW*(T'x-p’)  goes  to 
-»  as  A  goes  to  +00,  then  W*(T'x-p')  must  be  strictly  negative. 
Combining  this  last  observation  with  the  feasibility  criterion  (5.2) 


completes  the  proof. 
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This  last  proposition  suggests  the  following  algorithm  for  producing 
a  feasible  solution  x  in  K. 

Algorithm  (5.5). 

(i)  At  the  start  of  the  ifch  iteration  a  set  S*  of  linear  equations 
and  inequalities  in  the  variables  x  are  given.  (At  the  start  of  the 
first  iteration  S1  is  just  the  set  of  linear  relations  determining 

Kj ,  viz.  Ax  *  b,  x  t  0.) 

(ii)  A  feasible  solution  x*  satisfying  the  linear  relations  S* 
is  sought.  If  none  exists  the  stochastic  program  is  declared  infeasible 
and  the  algorithm  terminates. 

(iii)  For  each  row  W*  of  the  polar  matrix  W*  in  turn,  the  convex 
program  (5.3)  is  solved  with  x  =  x1.  If  all  £  programs  have  nonnegative 
values,  x1  is  defined  to  be  x  and  the  algorithm  terminates.  Otherwise 
for  some  k  a  point  (p,T)  or  points  (p,T)  and  (p',T')  as  in 
proposition  (5.4)  are  found.  In  this  case  the  appropriate  inequality 
(W*T)x  1  W*p  or  (W*T')x  >  W*p'  is  added  to  S*  to  form 

S1+1  and  the  (i+l)St  iteration  is  started  from  step  (i) . 

If  £  is  a  convex  polyhedron  given  by  linear  equations  and  linear 
inequalities,  the  programs  (5.3)  to  be  solved  during  step  (iii)  of  the 
above  algorithm  are  linear  programs.  We  can  thus  be  more  explicit  in 
the  description  of  step  (iii): 

(iii')  ...  Otherwise  for  some  k  one  finds  either  an  optimal 


basic  solution  (p,T)  yielding  negative  objective  or  a  basic  solution 
and  a  direction  (p',T')  corresponding  to  an  unbounded  feasible  pivot 
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In  this  case  we  can  prove: 

Proposition  (5,6).  Suppose  l  used  in  the  definition  of  K2  can  be 
selected  to  be  a  convex  polyhedron  defined  by  linear  relations.  Then 
algorithm  (5.5)  using  step  (iii')  terminates  in  a  rinite  number  of 
steps.  It  either  generates  a  feasible  solution  of  the  program  or  it 
establishes  that  the  problem  is  infeasible. 

Proof.  It  suffices  to  show  the  finiteness  of  the  process.  This  follows 
immediately  from  the  fact  that  there  are  only  a  finite  number  of  rows  in 
W*  and  only  a  finite  number  of  basic  solutions  and  unbounded  basic 
pivots  for  each  problem  (5.3).  Thus  there  are  only  a  finite  number  of 
inequalities  which  can  be  added  to  S1*  Moreover,  once  an  inequality 
has  been  added  it  cannot  be  generated  again. 

Note  that  in  fact  this  proposition  gives  another  proof  of  the 
polyhedral  property  of  under  the  hypotheses  of  the  second  part  of 

theorem  (4,7).  If  I  is  not  polyhedral,  there  does  not  seem  to  be  any 
condition  one  could  impose  on  the  selection  of  (p,T)  or  (p * ,T * )  in 
step  (iii)  of  the  algorithm  (5.5)  which  would  insure  that  the  algorithm 
converges,  unless,  perhaps,  one  is  satisfied  with  an  epsilon  type  of 
feasibility  as  in  [Parrikh,  1967). 

Not  even  taking  into  account  the  suostantial  amount  of  work  which  the 
computation  of  W*  might  necessitate,  the  somewhat  labjrious  fashion 
by  which  the  algorithm  (5.5)  generates  a  feasiole  solution  is  due  to 
the  fact  that  to  test  the  feasibility  of  any  given  x,  one 


jr 
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has  to  take  into  consideration  if  not  all  points  of  :  „  (or  some  set 

P  >T 

derived  from  it)  at  least  a  sufficiently  large  number  so  as  to  make  the 
process  inefficient.  In  the  previous  section,  we  have  seen  that  a  con¬ 
siderable  simplification  is  possible  when  the  sets  A(x)  have  a  proper 
lower  bound  a_(x)  with  respect  to  the  ordering  induced  by  some  convex 

V/ 

cone  C  contained  in  pos  W.  If  this  is  the  case,  it  is  no  longer 

necessary  to  consider  the  whole  set  H  _,  or  some  large  subset  of  it 

P » i 

to  verify  the  feasibility  of  a  given  x.  As  shown  by  theorem  (4.17)  it 
will  be  sufficient  to  solve  only  one  linear  program  of  the  form  (5.1), 
namely , 


(5.7) 


Minimize  w  » 


+  , 

es  +  es 


Wy  +  Is  -  Is  =  ac(x) 
y  £  0,  s+  £  0,  s  i  0 


This  enormous  simplification  naturally  depends  on  our  capability 
of  finding  a  convex  cone  C  in  pos  W,  such  that  the  proper 
lower  bound  of  any  set  will  be  fairly  easy  to  compute.  In  the  remainder 
of  this  section  we  shall  assume  that  the  positive  orthant  pos  I  (or 
some  other  orthant  which  can  always  be  made  to  be  the  positive  orthant 
by  an  appropriate  change  in  sign  of  some  of  the  rows  of  the  equations 
T(C)x  +  Wy  =*  p(O)  is  contained  in  pos  W.  Given  the  practical  use  we 
want  to  make  of  this  assumption,  proposition  (4.19)  justifies  the  restriction 
to  this  case. 


If  the  convex  cone  C  of  theorem  (4.17)  and  its  corollary  can  be 
selected  to  be  the  positive  orthctnt,  then  A(x)  has  a  proper  lower  bound 
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if  it  contains  a  point  a  such  that  ot^  1  6^,  i  *  1 . in  for  all 

6  in  A(x)  C  Rm.  This  ordering  induced  by  pos  I  is  usually  referred 
to  as  the  componentwise  ordering.  Thus  in  this  case  verifying  if  A(x) 
has  a  proper  lower  bound,  and  if  it  does,  finding  it,  is  usually  fairly  easy  to 
do.  In  particular  if  T  is  fixed,  then 


A(x)  =  {p(0  |p(£)  e  2p}  -  Tx 


and  as  shown  in  corollary  (4.18)  it  suffices  to  find  a  proper  lower 
bound  of  Ep  (or  its  closed  convex  hull)  with  respect  to  the  component¬ 
wise  ordering  to  determine  a  lower  bound  of  A(x)  for  all  x.  In 


this  case  it  is  determined  by  a  _  -  Tx,  where  (a  T),  £  P.,  for 

3  pos  I  pos  I  i 

all  p  in  E  (or  its  convex  hull). 

P 


Feasibility  Criterion  (5.8).  Consider  a  stochastic  program  with  fixed 
recourse  whose  random  elements  satisfy  a  weak  covariance  condition. 
Suppose  that  for  all  x  the  set  A(x)  possesses  a  proper  lower  bound 
a  (x)  with  respect  to  the  ordering  induced  by  a  closed  convex  cone  C 

w 

contained  in  pos  W.  Then  x  in  Kj  is  feasible  if  and  only  if  the 
system  of  linear  relations 


(5.9)  aW  <  0,  ac*c(*)  >  0 

is  inconsistent,  where  a  is  an  m-row  vector  of  variables  a  ,  in 
particular,  if  C  a  pos  I  and  T  is  fixed,  then  x  in  Kj  is  feasible 
if  and  only  if  the  system  of  linear  relations 

(5.10)  aw  <  0,  a(a-Tx)  >  0 

is  inconsistent,  where  a  is  a  proper  lower  bound  of  - 


'f 
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with  respect  to  the  componentwise  ordering,  i.e.,  1  p^  for 

/■w 

all  p  in  E  • 

P 

Proof.  This  feasibility  criterion  is  an  immediate  consequence  of  theorem 

(4.17)  and  its  corollary,  since  if  either  sysem  above  is  solvable, 

then  there  exists  a  hyperplane,  determined  by  its  normal  a, 

separating  pos  W  and  ci^x)  in  the  first  case  and  pos  W  and 

a  -  Tx  *  a  ,(£)  in  the  second  case, 
pos  I 

For  computational  purposes,  the  following  proposition  supplements 
the  feasibility  criterion  given  above. 


Proposition  (5.11).  Consider  a  stochastic  program  with  fixed  recourse 

whose  random  elements  satisfy  a  weak  covariance  condition  and  suppose  that 

contains  the  positive  orthant  pos  I.  Suppose  further  that  the  rows  of 

T  and  p  are  independent  and  that  each  E^,  the  support  of  the  random 

variables  in  row  i  of  T  and  p,  is  bounded.  Then  a  T(x)  exists 

r  pos  I 

for  all  x  and  is  given  by 


ai(x)  =  Min{(pi-Tix)  |  (p,T)  e  ?i} 


where 
of  T 


ai(x) 
and  p 


is  the  i^h  component  of  <*pog  j(x). 
are  also  independent,  then 

n 


ai(x)  -  Min  pi 
=*i 


>  Max  t..x 

1-1  Ht  ij  ■ 
3  Cij 


Further  if  the  columns 


The  feasibility  criterion  (5.8)  is  a  generalization  of  the  feasibility 
test  found  in  [Wets,  1966— b;  Section  2].  It  is  not  difficult  to  see  that 
if  x  is  infeasible  and  we  find  some  o  satisfying  (5.9)  or  (5.10), 


i 


pos  W 
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then  we  are  in  a  very  similar  situation  to  that  in  algorithm  (5.5)  when 
we  found  some  row  W*  of  the  polar  matrix  of  W  and  a  point  (p,T)  of 
£  which  could  be  used  to  generate  a  linear  constraint  which  has  to  be 
satisfied  by  every  feasible  x  but  which  fails  to  be  satisfied  by  x. 

If  a c(i)  *  pc  -  Tc*,  where  (pc»Tc)  belongs  to  Ep  T  ,  then  if  a 
satisfies  (5.9),  the  hyperplane 

(°Tc)x  =  °PC 

separates  K2  from  ic.  When  T  is  fixed  the  closed  halfspace  con¬ 
taining  K2  determined  by  this  hyperplane,  can  be  written 
as 

(5.12)  (oT)x  >  aa. 

The  feasibility  constraints  of  type  (5.12)  bear  more  than  a  passing 
resemblance  to  those  found  in  proposition  (5.4). 

In  the  remaining  part  of  this  section  we  limit  ourselves  to  the  case  when  T 
is  fixed.  The  extension  of  the  results  below  to  the  case  when  T  also  contains 
random  elements  is  essentially  routine,  but  requires  the  introduction 
of  more  than  a  reasonable  amount  of  cumbersome  notation  which  seem 
hardly  justified  in  this  survey.  The  algorithm,  in  this  case,  is  again  a 
modification  of  the  algorithm  (5.5).  We  replace  step  (iii)  by 

(iii ’ ' )  Solve  the  linear  program 

+  . 

es  +  es 

Wy  +  Is+  -  Is  “a  -  Tx* 
y  £  0,  s+  *  0,  s  tO 


(5.13) 


Minimi ze  w 


— .  n 
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where  a  is  a  lower  bound  of  with  respect  to  the  ordering  induced  by 
pos  I.  Since  pos  W  c  pos  I,  the  artificial  variables  s+  can  be 
deleted  from  the  program  (5.13)  without  impairing  its  feasibility.  However, 
if  we  incorporate  them  in  our  formulation,  they  guarantee  a  starting  basis. 
If  w  =  0,  then  x1  is  a  feasible  solution  and  the  algorithm 
terminates.  Otherwise  at  the  optimum  there  is  a  set  of 
optimal  multipliers  a  such  that  oCa-Tx1)  >  0  and  oW  i  0  (compare 
these  relations  with  those  of  the  second  part  of  the  feasibility  criterion 
(5.8)).  In  this  case  the  inequality 

(5.14)  (oT) x  >  act 

is  added  to  S i  to  form  and  the  (i+l)st  iteration  is  started 

from  step  (i) . 


Proposition  (5.15).  Suppose  T  fixed  in  a  stochastic  program  with 
fixed  recourse  whose  random  variables  satisfy  a  weak  covariance  condition. 
Moreover,  suppose  that  a  is  a  proper  lower  bound  of  the  closed  convex  hull  of 
Ep  with  respect  to  the  ordering  induced  by  pos  I  and  pos  I  c  pos  W. 

Then,  the  algorithm  (5.5)  with  step  (iii'*)  terminates  in  a  finite  number 
of  steps.  It  either  generates  a  feasible  solution  or  recognizes  that  the 
stochastic  program  is  infeasible. 

Proof.  The  matrix  (W,I,-I)  of  program  (5.13)  contains  only  a  finite 
number  of  bases.  Thus  only  a  finite  number  of  optimal  multipliers  of 
type  o  can  be  generated.  Moreover,  once  a  constraint  of  type  (5.14) 
has  been  introduced  in  the  set  S1  it  can  never  be  generated  again. 


In  order  for  the  minimum  of  w  in  (5.13)  to  be  positive,  the  optimal 
solution  must  involve  some  of  the  artificial  variables  (s+,s~)  at  some 
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positive  level  since  otherwise  w  =  0,  which  implies  that  (a-Tx*) 
is  In  pos  W  and  hence  x*  in  K2.  Thus  in  fact  the  number  of  possible 
o  is  much  smaller  than  all  possible  bases  contained  in  (W,I,-I).  These 
vectors  o  are  in  fact  normals  to  bounding  hyperplanes  of  pos  W  which 
support  pos  W  in  a  set  containing  the  origin.  We  hav*  that 

Proposition  (5.16).  Suppose  that  the  basic  optimal  solution  to  (5.13) 
with  w  >  0  contains  exactly  one  of  the  artificial  variables  s  . 

Then  o  is  the  normal  of  a  supporting  hyperplane  of  pos  W  which  inter¬ 
sects  (supports)  pos  W  in  a  facet,  i.e.,an  (m-l)-dimensional  face  of 
pos  W. 

Proof.  By  assumption  (see  Section  2)  pos  W  is  of  dimension  m.  The 
proof  is  complete  if  we  observe  that  the  optimal  basis  contains  (in— 1) 
linearly  independent  points  of  pos  W  contained  in  a  hyperplane  supporting 
pos  W. 

Thus  if  Proposition  (5.16)  applies,  tie  are  generating  some  row  of  a 
polar  matrix  of  W.  Moreover,  every  row  of  W*  can  arise  in  this  way. 
However,  it  is  not  always  possible  to  obtain  the  normal  of  a  facet  of  pos  W 
by  solving  (5.13).  In  [Van  Slyke  and  Wets,  1969;  Sections  2.D  and  2.E)  it 
is  shown  that  even  though  this  process  will  in  some  sense  yeild  very  good 
constraints  on  x,  in  general  [Van  Slyke  and  Wets,  1969;  Proposition  (25) 
and  Corollary  (27)]  it  will  generate  more  than  a  minimal  set  of  supporting 
hyperplanes  of  pos  W.  Thus  in  general  the  row  matrix  obtained  from  the 
normals  of  these  hyper-planes  does  not  constitute  a  minimal  set  as  required 
by  the  definition  (4.9)  of  W*. 


i 
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6.  Characterizing  Relatively  Complete  Recourse.  As  mentioned  in  the 

beginning  of  Section  4,  the  models  studied  in  [Dantzig,  1955],  [Madansky, 

I960],  [Dantzig  and  Madansky,  1961],  [Charnes,  Cooper  and  Thompson, 

1965],  and  [Kali,  1967]  satisfy  the  relatively  complete  recourse  condition, 

i.e.,  for  all  x  in  K,  and  for  all  ?  in  H  there  exists  y  i  0 

i  p,  i 

such  that  Wy  *»  p(C)  -  T(S)x.  Since  practical  considerations  seem  to 
indicate  that  in  applications  this  condition  will  be  very  often  satis¬ 
fied  and  when  it  is,  the  work  involved  in  solving  the  stochastic  program  is  con¬ 
siderably  simplified,  it  is  of  paramount  importance  to  be  able  to  determine 
whether  this  condition  is  satisfied  or  not.  The  first  efforts  in  this 
direction  can  be  found  in  [Wets,  1966-b],  [Kail,  1967],  [Wets,  1966-c]  and 
Dempster,  1968].  The  hindsight  that  these  studies  have  given  us,  shows 
that  this  problem  has  close  ties  [Wets,  1966-c],  [Dempster,  1968,  Section 
5],  with  the  theory  of  positive  linear  dependence  developed  is  due 
by  [Davis,  1954],  [McKinney,  1962],  [Bonnice  and  Klee,  1963],  and  more 
recently  by  [Reay,  1965-a],  [Reay,  1965— b ]  and  [Hansen  and  Klee,  1969]. 

The  study  of  various  special  forms  of  stochastic  programs  with  recourse 
[Walkup  and  Wets,  1969-a]  suggests  that  it  is  convenient  to  distinguish 
the  following  cases: 

Definition  (6.11).  A  stochastic  program  is  said  to  have 

(i)  relatively  complete  recourse  if  K2  DKj; 

(ii)  complete  recourse  if  pos  W  =  Rm; 

(iii)  simple  recourse  if  W  =  (1,-1),  up  to  permutations  of  rows 
and  columns  if  necessary. 


Obviously,  if  W  *  (1,-1)  then  pos  W  =  Rm  and  thus  simple  recourse 
implies  complete  recourse  which  in  turn  implies  relatively  complete 
recourse.  This  terminology  was  introduced  in  [Walkup  and  Wets,  1969-a], 

(It  differs  from  the  one  used  in  [Wets,  1966-a]  where  the  problem  with 
simple  recourse  was  designated  as  the  complete  problem  in  recognition 
of  the  fact  that  it  is  a  special  case  of  (6.1. ii) .  Subsequent  develop¬ 
ment  of  the  subject  has  suggested  the  distinction  given  here).  To  verify 
if  a  given  problem  has  relatively  complete  recourse  theoretically  involves 
computing  K2  and  then  verifying  if  the  convex  polyhedral  set  is  contained 

in  the  convex  sec  K2<  Thus,  aice  more  we  encounter  here  the  problem  of 
determining  if  a  convex  polyhedron  is  contained  in  a  convex  set.  As 
already  mentioned  in  Section  5,  this  problem  might  be  easy  or  difficult, 
all  depending  on  the  manner  in  which  these  two  sets  are  defined.  We  shall 
not  pursue  this  matter  any  further  here,  at  least  not  at  this  level  of 
generality.  So  far  no  general  method  to  solve  this  particular  problem 
has  been  investigated.  In  the  literature  we  know  of  only  one  example 
of  a  problem  with  relatively  complete  recourse  but  not  complete  recourse. 

Such  a  model  was  formulated  by  Tintner  [Tintner,  1960]  in  connection  with 
the  allocation  of  available  resources  in  agriculture  economics.  This 
model  was  later  given  the  name  of  active  approach  to  stochastic  programming 
[Sengupta,  Tintner,  and  Millham,  1963],  In  [Walkup  and  Wets,  1969-a, 

Section  4]  it  is  shown  how  this  problem  can  be  approached  advantageously 
by  the  techniques  developed  for  stochastic  programs  with  recourse. 

Rather  than  seeking  to  characterize  relatively  complete  recourse,  the 
research  has  concentrated  on  fb®  characterization  of  complete  recourse. 
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In  [Kail,  1967,  Section  4]  one  finds  various  theorems  yielding  sufficient 
conditions  for  complete  recourse.  These  theorems  correspond  essentially  to  matrix 
versions  of  the c aratheodory  and  Stinitz  theorems  [Reay,  1965-a]  for  polyhedral 
cones.  However,  as  mentioned  in  the  beginning  of  this  section,  this  problem 
can  best  be  handled  in  a  somewhat  more  general  setting.  In  [Wets, 

1966-c]  and  perhaps  even  more  clearly  in  [Dempster,  1968,  Section  5]  one 
can  see  that  the  basic  question  can  be  formulated  as:  Given  an  m  *  n 
matrix  A  determine  the  (facial)  structure  of  the  cone  pos  A  generated 
positively  by  the  points  corresponding  to  the  columns  of  A;  in  particular, 
determine  if  A  contains  a  subset  of  columns  which  constitute  a  positive 
basis  for  Rm. 

Definition  (6.2).  A  subset  of  columns  (A1,..., A  )  *  B  of  the  matrix 
A  is  a  positive  basis  for  Rm,  if  pos  B  *  Rm  and  the  columns  of  B 
constitute  a  frame  (4.8),  i.e.,  are  positively  linearly  independent. 

In  the  articles  devoted  to  the  theory  of  linear  dependence,  various 
properties  of  positive  bases  have  been  found.  One  particularly  useful 
characterization  can  be  found  in  [Reay,  1965-a],  An  algebraic  version  of 
his  theorem  can  be  found  in  [Wets  and  Witzgall,  1968,  Proposition  9], 

An  algorithm  determining  if  a  given  cone  pos  A  does  or  does  not  contain 
a  positive  basis  can  be  found  in  [Wets  and  Witzgall,  1967].  The  two 
last  references  deal  with  more  general  problems  related  to 
the  algebraic  characterization  of  the  facial  structure  of  convex  polyhedral 
cones.  As  far  as  we  are  concerned  here,  one  can  find  there  some  indication 
of  the  work  involved  in  obtaining  frames,  k-faces  for  pos  W  and  in 
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particular  the  polar  matrix  of  W.  The  particular  problem  of  determining 
if  a  stochastic  program  has  complete  recourse  can  be  settled  by  finding  the 
lineality  space  of  pos  W  [Wets  and  Witzgall,  1967,  Section  4],  where  the 
lineality  space  denoted  by  £  pos  W  is  defined  as  the  union  of  all  the 
lines  contained  in  pos  W.  In  [Wets  and  Witzgall,  1967]  it  can  be  seen 
that  finding  £  pos  W  amounts  to  a  fairly  small  amount  of  computational 
work.  Obviously,  we  have  the  following  proposition: 

Proposition  (6.3).  A  stochastic  program  has  complete  recourse  if  and 
only  if  the  dimension  of  £  pos  W  is  m. 

In  general,  if  m  -  dim(jgpos  W)  is  small,  the  effort  involved 
in  finding  the  lineality  space  is  by  no  means  wasted,  since  in  this 
case  computing  the  polar  matrix  W*  would  be  very  easy*  This  would 
allow  us  to  use  some  of  the  algorithmic  procedures  described  in  the  pre¬ 
vious  section  which  involve  as  prerequisite  the  computation  of  W*. 

7,  The  Objective  Function.  The  three  preceding  sections  have  been  essentially 
devoted  to  obtaining  various  properties  of  the  set  K0  on  which  Q(x)  <  +®> 
which  with  Kj  determine  the  feasibility  region  of  the  stochastic  program 
(2.2).  In  this  section  we  shall  be  especially  concerned  with  the  properties 
of  z(x)  on  K  or  more  particularly  of  Q(x)  on  K2 .  In  order  to 
derive  these  properties  we  shall  rely  on  some  results  from  the  perturbation 
theory  for  linear  programming.  Although  we  could  use  some  more  elementary 
facts  to  obtain  certain  of  the  desired  results,  the  theorem  (7.2)  below 
is  probably  best  suited  to  our  purposes,  and  is  also  a  very  useful  conceptual 
tool  in  the  general  area  of  stochastic  programming.  It  has  been  used 
[Walkup  and  Wets,  1968]  to  study  the  properties  of  decision  rules,  so 
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prominent  in  literature  devoted  to  stochastic  programs  with  chance- 
constraints.  In  order  to  allow  us  to  rely  on  the  intuitive  geometric 
content  of  this  result,  we  need  the  following  definition. 

Definition  (7,1).  A  finite  closed  polyhedral  complex  will  be  any  finite 
collection  X  of  closed  convex  polyhedra,  called  cells  of  X  ,  such 
that: 

(i)  If  C  is  a  cell  of  X  then  every  closed  face  of  C  is  a 
member  of  X. 

(ii)  If  Cj  and  C2  are  distinct  cells  of  X ,  then  either  they 
are  disjoint,  or  one  is  a  face  of  the  other,  or  their  inter¬ 
section  is  a  face  of  each. 

Theorem  (7.2)  (BASIS  DECOMPOSITION  THEOREM).  Let  P(t)  denote  the 
linear  program 

Minimize  cx 
subject  to  Ax  =  t 
x  >  0 

where  c  is  fixed  and  A  is  a  fixed  m  *  n  matrix  of  rank  m.  Then: 

(i)  P(t)  is  feasible  if  and  onlv  if  t  lies  in  pos  A. 

(ii)  Either  P(t)  is  bounded  for  all  t  in  pos  A  or  P(t) 
is  unbounded  for  all  t  in  pos  A. 

(iii)  If  P(t)  is  bounded  there  exists  a  decomposition  of  pos  A 
into  a  finite  closed  polyhedral  complex  X  whose  cells  are 
simplicial  cones  with  vertex  at  the  origin,  and  a  one-to-one 
correspondence  between  the  one-dimensional  cells  of  X  and 
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selected  columns  of  A  which  generate  them  such  that 

(a)  the  closed  m-dimensional  cells  of  Oi  cover  pos  A,  and 

(b)  the  m  columns  of  A  associated  with  the  edges  of  a 
closed  m-dimensional  cell  C  of  Oi  constitute  an 
optimal  basis  for  all  t  in  C. 

This  theorem  which  is  proved  in  [Walkup  and  Wets,  1969-b]  has 
various  important  consequences,  e.g.,  it  follows  from  part  (iii)  that 
provided  P(t)  is  bounded  there  exists  a  piecewise  linear  con¬ 
tinuous  function  x(t)  which  determines  a  basic  optimal  solution 
for  t  in  pos  A.  The  particular  consequences  of  interest  here  are 
given  in  the  two  following  corollaries. 

Corollary  (7.3).  The  function  Q(t)  =  {Min  cx|Ax  =  t,  x  ±  0}  is  a  finite 
convex  polyhedral  function  on  pos  A  unless  Q(t)  =  -°°  for  some  t  in 
pos  A,  in  which  case  Q(t)  is  identically  -*»  on  pos  A. 

Proof.  The  finiteness  and  unboundedness  situations  are  taken  care  of 
by  part  (ii)  of  the  above  theorem.  For  the  remainder  it  suffices  to  observe 
that  Q(t)  will  be  linear  on  every  simplicial  conical  cell  of  the  poly¬ 
hedral  complex  Oi  generated_by  the  decomposition  of  pos  A,  and  that 
the  convexity  of  Q(t)  follows  from  the  fact  that  if  x®  and  x1  are 
optimal  solutions  for  t  =  t° ,  t1,  then  (1-A)x°  +  Ax1  is  a  feasible  but 
not  necessarily  optimal  solution  when  t  =  (1-A)t°  +  At1.  «*- — 

Corollary  (7.4)  .  The  function  Q*(t)  =  iMin  tx|Ax  =  b,  x  ^  o}  is  a  finite 

T  T  T 

concave  polyhedral  function  which  for  every  vector  t  in  pos (A  ,-A  ,1) 

=  {t|t  =  uA-vA+sI,u>0,v>0,s*0}  unless  Q*(  t)  =  +“>  for 
T  T  T 

some  t  in  pos(A  ,-A  ,1)  in  which  case  Q*(t)  is  identically  +“>  on 
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T  T 

pos(A  ,-A  ,1). 

Proof.  This  corollary  follows  trivially  from  the  previous  corollary 
and  a  straightforward  application  of  the  standard  duality  theorem  of 
linear  programming. 

It  is  now  easy  to  see  that: 

Proposition  (7.5).  The  function  Q(x,£)  =  Q(x, [q(4) ,p(4) ,T(4) ])  is  a 
convex  polyhedral  function  in  x  on  K2  for  each  4  in  E.  Moreover, 
it  is  concave  polyhedral  in  q(£)  and  convex  polyhedral  in  (p (4) » T( 4) ) • 

Proof.  By  definition  Q(x,£)  equals  {Min  q(4)y|Wy  =  p(4)  -  T(£)x,  y  £  0}. 
The  right-hand  sides  of  the  constraints  of  this  problem  are  linear 
in  x  and  (p(0  ,T(0)  •  Application  of  Corollary  (7.3)  yields  the 
assertions  of  the  proposition  with  respect  to  x  and  (p(0*T(4)).  The 
remainder  follows  from  corollary  (7.4). 

Note  that  the  above  proposition  is  not  restricted  to  the  domain  of 

finiteness  of  Q(x,4)  but  in  fact  holds  for  all  x  in  Rn  and  £  in 
N 

EC  R  provided  one  adopts  the  standard  convention  of  setting  Q(x,£)  =  +°° 
if  the  constraints  define  an  empty  set  and  Q(x,4)  =  -°°  if  the  problem 
is  unbounded.  This  fact  would  allow  us  to  prove  the  first  assertion  of 
the  theorem  below  without  any  restriction  whatsoever  on  the  distribution 
of  C;  in  fact,  the  convexity  of  z(x)  holds  even  when  W  is  also  a 
random  matrix  [Walkup  and  Wets,  1967-b  ;  Theorem  (4.'')], 

Theorem  (7.6) .  Consider  a  stochastic  program  with  fixed  recourse 
(2.1)  whose  random  elements  satisfy  a  weak  covariance  condition.  Then 
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z(x)  =  cx  +  Q(x)  =  E.fc(Ox  +  Q(x,£)}  is  a  convex  function  on  K. 

Moreover,  z(x)  is  either  finite  on  K  or  z(x)  is  identically  -<*> 
on  K. 

Proof.  Since  cx  is  linear  in  x  and  K2  D  K,  it  is  sufficient  to  prove 
the  above  assertions  with  z(x)  and  K  replaced  by  Q(x)  and  K2 
respectively.  The  convexity  of  Q(x)  follows  directly  from  the  isotone 
and  subadditivity  of  the  integral  /‘dp  and  proposition  (7.5)  which 
yields  the  convexity  of  Q(x,0  in  x.  By  theorem  (4.1)  the  function 
Q(x)  is  less  than  +»  for  all  x  in  K2 ,  thus  to  complete  the  proof  it 
suffices  to  show  that  if  Q(k)=-°°  for  some  x  in  ,  then  Q(x)  =  -00 
for  all  x  in  Suppose  Q(x)  =  -®  for  some  x  in  K2  then  the 

set  U|Q(x,0  •=  must  have  positive  measure.  This  follows  from  our 

definition  of  the  integral  and  the  weak  covariance  condition.  By 
corollary  (7.3),  for  any  £  in  If,  Q(fc,£)  =  implies  Q(x,5)  = 

for  all  x  in  K„ .  Thus  for  all  x  in  K  the  set  {clQ(x»5)  =  -00} 

t.  c. 

has  positive  measure,  i.e.,  Q(x)  =  for  all  x  in  K2 . 

In  general  Q(x) ,  and  thus  z(x),  are  not  continuous  on  K,  but 
under  very  general  conditions  one  can  prove  that  Q(x)  is  lower  semi- 

continuous  on  the  set  on  which  it  is  finite  [Walkup  and  Wets,  1969-c], 

The  lower  semicontinuity  of  z(x)  is  in  fact  sufficient  to  imply  its 
continuity  if  we  can  show  that  Ko  is  polyhedral  (see  Section  4)  ,  since 

<L 

every  convex  function  is  upper  semicontinuous  on  a  convex  polyhedron 
[Gale,  Klee  and  Rockafellar,  1968].  Under  the  conditions  we  have  imposed 
on  the  problem  (2.2),  we  can  prove  a  much  stronger  continuity  condition 
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which  among  other  things  allows  us  to  show  in  the  next  section  that  the  deter¬ 
ministic  equivalent  program  (3.2)  possesses  strong  regularity  properties. 

Theorem  (7.7).  Consider  a  stochastic  program  with  fixed  recourse  whose 
random  elements  satisfy  a  weak  covariance  condition.  Suppose  z(x)  is  bounded 
on  K.  Then  z(x)  satisfies  a  Lipschitz  condition,  i.e.,  there  is  some 
constant  B  such  that  x,x°  in  K  imply 

I  z(x)  -  z(x°)|  <  B  II  X  -  x°|| 

where  ||*  ||  denotes  the  Euclidean  norm  in  Rn. 

Proof.  Again  the  linearity  of  cx  allows  us  to  restrict  our  attention 
to  Q(x)  .  We  must  show  that  if  Q(x)  >  on  K2  and 
x,x°  e  K2  then  there  exists  some  constant  B  such  that 

lQ(x)  -  Q(x°)  |  <  B  ||  x  -  x°  ||  . 

Given  any  x  in  K2  and  E,  in  5,  Q(x,0  is  finite  by  Theorem 
(7.6)  and  can  be  expressed  in  terms  of  a  basic  solution  of  a  linear 
program  by  writing 

(7.8)  Q(x,Q  =  q(C)(.)W~.1)(p(g  -  T(C)x) 

where  is  a  square  nonsingular  submatrix  of  W  of  rank  m  and 

q(C)^j  is  the  corresponding  subvector  of  q(£)  as  in  theorem  (4.1). 

Since  by  proposition  (7.3)  the  function  Q(x,£)  is  convex  polyhedral  in 


x,  the  function 
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achieves  its  maximum  when  x  and  x°  both  belong  to  the  region  of 
linearity  which  has  maximum  slope.  For  x  and  x°  in  this  region  by  (7.8) 
we  have  that  there  exist  some  index  (i)  such  that 

(7.9)  | Q(x,0  -  Q(x°  ,£)  j  =  |q(0(i)W~j)T(0(x°-x)| 

i  b,..  l|q(of.JHIT(0]Hi*°  -*ll 

(i)  (i) 

where  B,..  is  some  constant  related  to  the  determinant  of  W,!,., 

(i)  (i) 

By  the  covariance  condition  (2.1)  the  right-hand  side  of  the  inequality 
is  integrable.  Since  the  integral  is  order  preserving  we  have  that 

| Q (x)  -Q(x°)|  <  /|Q(x,S)  -  Q(x°,C)[dF(C) 

<  B(i)  ||x°  -  x  || / ||q(C)(i)IH|T(C)||dKO  i  B||x°  -  x|| 

where  B  is  the  maximum  over  (i)  of  /llq(5)(i)IM|T(0||dF(C).  » 

is  finite  since  by  theorem  (7.2)  there  are  only  a  finite  number  of  cells 
in  Oi  and  for  each  index  (i)  the  finiteness  of  the  integral  is  assured  by  the 
covariance  condition  (2.1). 

So  far  we  have  made  very  little  use  of  the  form  of  the  distribution 
of  £  to  derive  the  properties  of  the  objective  of  the  deterministic 
equivalent  program  (3.2),  except  naturally  for  the  covariance  condition. 

Below,  we  obtain  two  interesting  characterizations  of  Q(x),  or  equi¬ 
valently  of  z(x),  which  rely  on  some  further  properties  of  F(S)*  The 
first  one  of  these  theorems  (7.17)  can  be  obtained  in  many  ways;  for  example, 
one  could  make  use  of  the  representation  of  the  epigraph  of  Q(x,0  in 
terms  of  its  supporting  hyperplanes,  i.e.,  use  the  properties  of  the  polar 
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matrix  of  jjj  q  [Wets,  1967],  or  one  could  also  use  some  arguments 
involving  the  generalized  inverse  of  W.  However,  in  order  to  unify 
our  treatment,  we  shall  rely  on  Theorem  (7.15),  which  is  a  mild 
generalization  of  a  lemma  in  [Dantzig  and  Madansky,  1961]. 

A  pair  (x,0  e  K2xE  is  said  to  be  acceptable  if  Q(x,C)  is  finite. 

In  view  of  Theorem  (7.7)  it  is  pointless  to  consider  any  other  situation, 
and  thus,  for  the  remainder  of  this  section  we  shall  limit  ourselves  to  this 
case.  From  duality  theory,  it  follows  that  the  linear  program 

(7.10)  Maximize  w  »  1T[p(0  -  T(5)x] 

subject  to  nW  f  q( 0 

where  it  is  an  m-row  vector,  is  feasible  and  bounded  whenever  the  pair 
(x,?)  is  acceptable.  Let 

D(S)  =  HuW  <  q( 0  } 

be  the  polyhedron  determined  by  the  constraints  of  (7.10).  Its  set  of 
vertices  will  be  denoted  by  ext  D(S).  Note  that  ext  D(£)  might  be 
empty,  but  if  it  is  empty  for  some  £,  then  it  is  also  empty  for  all  £ 
in  H.  If  this  is  the  case  and  since  the  programs  (7.10)  are  bounded  for 
(x,£)  e  K2xH  we  must  then  be  confronted  with  an  acute  infection  of  degeneracy. 

For  each  acceptable  pair,  let  H(x,0  be  the  set  of  optimal  solutions 
to  (7.10),  i.e.,  for  each  7r(x,S)  in  Jl(x,0  we  have  that 
n(x,C)[p(0  -  T(£)x]  =  Q(x,£).  The  set  n(x,£)  is  the  convex  hull  of 
vertices  and  extreme  rays  of  D(£) .  By  nt(x,0  we  denote  the  convex 
hull  of  the  vertices  of  D(?)  contained  in  Jl(x,0-  Note  that 
n  (x,S)  is  empty  only  if  ext  D(S)  is  empty. 
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Proposition  (7.11).  For  each  x  in  K2,  there  exists  a  countable 
family  { tt (x, J;) }  with  domain  E  and  range  Rm,  with  tt(x,£)  ^-measurable 
and  such  that  {tt(x,£)}  is  dense  in  n(x,£)  for  all  £  in  E.  Such 
a  function  tt(x,£)  will  be  called  an  ^-measurable  selector. 

Proof.  For  each  x  in  K2,  the  graph  { (H(x,£) , £) | £  e  =}  of  the 

i  jh 

multivalued  function  II(x,£)  is  a  Borel  subset  of  R  *  S.  This  follows 
immediately  from 

(i)  n(x,£)  can  be  described  by  a  finite  number  of  algebraic 
expressions  in  p(£),T(£)  and  q(£)  which  are  obtained 
from  the  optimality  and  feasibility  requirements  for  linear 
programs ; 

ft 

(ii)  E  is  a  closed  subset  of  R  ;  and 

(iii)  p(£),T(£)  and  q(£)  are  coordinates  (projections)  of  £. 

Now,  note  that  for  all  £  in  E,  the  sets  JI(x,£)  are  non-empty  and  closed. 

N 

Since  3  is  the  completion  of  the  Borel  algebra  on  R  ,  a  theorem  on 
measurable  selections  [Castaing,  1967,  Theorem  (5.4)]  yields  the  existence 
of  the  ^-measurable  selectors  {tt(x,£)}. 

For  the  remainder  of  this  section,  all  we  need  is  the  existence  of  some 
^-measurable  selector  tt(x,£)  in  H^(x,£).  This  can  be  obtained  by  invoking 
some  weaker  result  on  measurable  selectors  [Freedman,  1966;  Theorem  (4)]  or  by 
relying  on  the  fact  that  in  this  case  each  function  tt(x,£)  is  the  convex  com¬ 
bination  of  a  finite  number  of  "extreme"  functions  tt(x,£)  passing  through  the 
vertices  of  polytopes  determined  by  n  (x,£).  A  constructive  but  rather  lengthy 
proof  of  the  existence  of  some  ^-measurable  selector,  can  also  be  found  in 
[Kail,  1967,  Section  i,  Satz  1], 


ja 
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Proposition  (7.12).  Consider  an  acceptable  pair  (x,£).  Suppose  that 
D(£)  ^  0  and  let  ir(x,£)  e  jf(x.£).  Then  the  hyperplane 
H  =  {(z,x)|z  +  7i(x,£)T(£)x  «  ir(x,Op(0}  is  a  supporting 
hyperplane  of  the  epigraph  {(z,x)|z  2  Q(x,£),  x  e  K2}  of  the  convex 
polyhedral  function  Q(x,£)  at  the  point  (Q(x,£),x).  Moreover, 

|  1  tt(x , 0 T( C)  1 1  -  B(£)  where  B(£)  is  the  maximum  slope  of  a  linear  part 
of  the  function  Q(x,£). 

Proof.  The  first  part  of  the  proposition  follows  from  the  fact  that  for 
all  x  in  K2  and  £  in  H,  m(x,£)  is  a  feasible  but  not  necessarily 
optimal  solution  of  corresponding  linear  program  (7.10),  ana  thus 

Q(x,£)  =  ir(x,£)(p(£)  -  T(£)x]  >  ir(x,£)[p(£)  -  T(£)x], 

Hence,  for  all  x  in  K2  and  z  -  Q(x,£) ,  i.e.,  for  the  points  belonging 

to  the  epigraph  of  Q(x,£),  we  have  that 

(7.13)  z  +  tt(x,£)T(£)x  >  ir(x,£)p(5). 

That  H  supports  at  (Q(x,£),x),  follows  from  the  identity 

(7.14)  Q(x,£)  =  7I(x,£)  [p(£)  -  T(£)x]. 

The  remainder  follows  from  the  observation  that  fl(x,£)  is  a 

vertex  or  a  convex  combination  of  vertices  of  D(£),  which  correspond  to 

basic  solutions  of  (7.10).  Arguments  similar  to  those  invoked  to  obtain  (7.9) 
yield  the  desired  inequality. 

The  first  i'art  of  the  following  theorem  is  a  slight  generalization  of 


Lemma  2  in  [Dantzig  and  Madansky,  1961],  Although  it  is  a  trivial 
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consequence  of  the  two  previous  propositions,  it  has  proven  to  be 
extremely  useful  as  a  conceptual  guide  when  one  seeks  algorithmic  pro¬ 
cedures  for  solving  stochastic  programs. 

Theorem  (7.15).  Let  x  belong  to  K2  and  tt(x,£)  is  an  ^-measurable 
selection  of  n^(x,£).  Then  the  hyperplane  f(z,x)|z  +  E„{ n(x,C)T(C) }x  = 

Ej.|ti(x,Op(0  } }  is  a  supporting  hyperplane  of  the  epigraph 
{(z,x)|z  t  Q(x),x  e  K of  Q(x)  at  the  point  (Q(x) ,x) .  Moreover, 

|  |  ^(x.OTCC)  |  | }  -  B  where  B  is  the  Lipschitz  constant  of  Q(x) 
as  in  (7.7). 

Proof.  The  first  part  of  the  theorem  follows  from  integrating  both  sides 
of  the  relations  (7.13)  and  (7.14).  The  measurability  question  is  taken 
care  of  by  the  fact  that  in  each  case  the  expressions  involved  are 
continuous  functions  of  measurable  function  and  the  finiteness  of  the 
integrals  is  assured  by  our  assumptions  on  problem  (7.10)  and  the 
covariance  condition  (2.1).  As  for  the  remainder,  it  follows  straight¬ 
forward  from  (7.9)  and  the  definition  of  Jl’!(x,£). 

Corollary  (7,16).  Suppose  the  matrix  T  is  fixed.  For  all  x  in  K? , 
let  ff(x)  =  E.{tt(x,C)}  where  tt(x,£)  is  an  ST-measurable  selection.  Then 
the  vector  (1,tt(x)T)  is  the  normal  of  a  supporting  hyperplane  of  the 
epigraph  of  Q(x)  at  (Q(x) ,x) .  Moreover,  ||tt(x)t|!  t  B, 


If  5  .Is  a  finite  set,  i.e.,  when  F(£)  is 


a  finite  discrete  distribution,  then  Q(x)  is  a  convex  polyhedral 
function. 

Proof.  Q(x)  =  E^{q(x,£)}  is  by  (7.5)  a  convex  combination  of  a  finite 
number  of  polyhedral  functions  in  x. 

Combining  the  last  theorem  with  the  second  part  of  theorem  (4.7) 
it  follows  naturally  that  when  T  is  finite  the  deterministic  equivalent 
program  (3.2)  can  be  written  as  the  minimization  of  a  convex  polyhedral 
function  on  a  convex  polyhedron  or  by  introducing  some  additional  con¬ 
straints  as  a  linear  program.  One  way  to  do  so,  but  not  necessarily 
the  most  efficient  one  (especially  if  the  assumption  of  relatively  complete 
recourse  is  not  satisfied  and  some  of  the  components  of  q  and  T  are 
random) ,  is  to  express  the  problem  as  a  large-scale  linear  program  along 
the  lines  of  [Dantzig  and  Madansky,  1961;  (29),  (37)],  a  variant  of  which 
can  be  found  in  [Wets,  1966— b  ;  Section  3B,  Case  1], 

If  F(0  is  an  absolutely  continuous  distribution,  then  the  following 
propositions  can  be  found  in  [Kail,  1967],  and  [Wets,  1966-b],  respectively. 

Proposition  (7.18).  Consider  a  stochastic  program  with  complete  recourse, 
such  that  q  is  fixed  and  F(£)  is  an  absolutely  continuous  distribution. 
Then  Q(x)  is  differentiable  on  K2  =  Rn. 

Proposition  (7.19).  Consider  a  stochastic  program  with  fixed  recourse  such 
that  q  and  T  are  fixed  and  F(£)  is  an  absolutely  continuous  distri¬ 
bution;  then  Q(x)  is  differentiable. 


Both  proofs  rely  essentially  on  the  fact  that  for  a  given  x, 
n(x,0  is  only  multivalued  on  sets  of  measure  zero.  Thus  in  view  of 
theorem  (7.15),  integrating  n(x,C)T(0  on  5  where  tf(x,£)  is  any 
<7-measurable  selection  always  determines  the  same  supporting  hyperplane 
of  the  epigraph  of  Q(x).  From  this  it  is  implied  that  the  supports  are  unique 
for  all  x  in  i.e.,  the  convex  function  Q(x)  is  differentiable 

[Rockafellar,  1969;  Section  25].  Although  both  propositions  are  correct,  their 
proofs  are  incomplete  since  they  fail  to  show  that  every  normal  to  a  support 
of  Q(x)  can  be  obtained  as  the  integral  of  ^-measurable  selectors  of 
n(x,0.  This  and  some  generalizations  of  the  above  propositions  will 
be  included  in  a  projected  paper. 

For  stochastic  programs  with  simple  recourse,  it  suffices  that  the 
marginal  distribution  of  the  subvector  of  random  variables  (pi(0  ,I\(S)  ^(5)) 
i  ■  l,.,.,m  be  absolutely  continuous  [Walkup  and  Wets,  1969-a;  Proposition 
(2.8)].  If  only  the  right-hand  sides  p(£)  are  random,  it  suffices  that 
each  marginal  distribution  of  £  be  continuous  [Wets,  1966-a;  Proposition 
(21)].  All  these  constitute  sufficient  conditions  for  differentiability 
of  Q(x).  There  does  not  seem  to  be  any  simple  condition  which  would  also 
be  necessary  for  the  differentiability  of  Q(x). 

8.  Some  Regularity  Properties  of  the  Equivalent  Program.  The  study  of 
constrained  optimization  has  led  to  various  regularity  conditions  for  opti¬ 
mization  problems  which  in  some  sense  determine  if  the  problem  is  "well" 
formulated  and  usually  give  some  indication  as  to  the  type  of  method(s) 
one  could  reasonably  expect  to  generate  solution  procedures.  The  standard 


approach  is  to  study  the  effect  that  small  perturbations  of  some  of  the 
constraints  will  have  on  the  optimum.  For  convex  programs  these  regularity 
conditions  have  been  traditionally — and  for  good  reasons — related  to  the  pro¬ 
perties  of  a  so-called  dual  problem,  although  they  can  very  often  be  verified 
without  necessarily  deriving  the  actual  dual  problem  [Rockafellar,  1967], 

[Van  Slyke  and  Wets,  1968],  [Rockafellar,  1968]. 

Definition  (8.1).  A  convex  program  f s 

(i)  feasible  if  the  set  determined  by  the  constraints  is  nonempty, 

(ii)  solvable  if  the  value  of  the  infimum  is  finite  and  achieved 
for  some  value  of  the  variable, 

(iii)  dualizaole  if  there  is  no  duality  gap,  i.e.,  if  the  optimal 
value  of  the  convex  program  and  its  dual  are  equal, 

(iv)  stable  if  there  exist  (optimal)  nontrivial  Lagrange  multi¬ 
pliers  or  equivalently  for  convex  programs  if  the  dual  problem 
is  solvable. 

The  terminology  used  here  differs  from  that  used  by  [Rockafellar,  1967] 
and  [Van  Slyke  and  Wets,  1968]  in  only  one  respect:  The  dualizable 
condition  corresponds  to  what  they  refer  to  as  normality.  Note  that  if  a 
convex  program  is  stable,  it  is  also  dualizable  [Van  Slyke  and  Wets, 

1968;  Proposition  (6.8)]  and  obviously  that  solvability  implies  feasi¬ 
bility. 
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In  Sections  4  and  7  we  have  established  that  the  deterministic 
equivalent  program  of  a  stochastic  program  with  fixed  recourse  whose 
random  elements  satisfy  a  covariance  condition  is  a  convex  program  of  the 
form 

(8.2)  Find  inf  z(x)  •  cx  +  Q(x) 

Ax  -  b 

U*TU)x  1  W*p(0  VrC? 

P.T 

x  :  o 

where  z(x)  is  a  convex  function  which  is  either  identically  -<*  on 
the  subset  K2  of  Rn  determined  by  the  induced  constraints  or  it  is 
finite  on  I,  in  which  case  it  is  Lipschitzian  with  constant  B  ■  ||c|j  +  B, 
where  B  is  the  constant  for  Q  as  defined  by  Theorem  (7.7).  Here,  we 
shall  consider  perturbations  of  the  fixed  constraints  Ax  •  b.  Following 
[Van  Slyke  and  Wets,  1968;  Section  3]  we  can  thus  write  the  dual  program 
of  (8.2)  as 

(8.3)  Find  sup  v 

subject  to  v  <  Q(x)  +  (c-ttA)x  +  iTb 

for  all  x  e  K2  {x|x  Z.  0} . 

This  program  can  be  interpreted  as  seeking  the  "highest"  supporting 
hyperplane  of  the  epigraph  6  of  the  variational  function 
<|>(u)  ■  {inf  z(x) | Ax  ■  b  -  u,  x  e  K2  H  . 
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Characceri zing  feasibility  for  the  program  (8.2)  has  been  the  burden 
of  Section  5.  In  the  remainder  of  this  section  we  investigate  some 
sufficient  conditions  for  the  program  (8.2)  to  satisfy  one  or  more  of  the 
properties  listed  in  definition  (8.1).  We  shall  see  that  for  a  broad 
class  of  stochastic  programs  with  fixed  recourse,  the  equivalent  convex 
program  possesses  the  desirable  regularity  properties. 

Theorem  (8.4).  Consider  a  stochastic  program  with  fixed  recourse  whose 
random  elements  satisfy  a  weak  covariance  condition  and  suppose  that  the 
constraint  set  K  is  bounded,  then  the  deterministic  equivalent  program 
(8.2)  is  solvable  and  dualizable. 

Proof.  If  z(x)  -  -®  on  K,  the  theorem  follows  trivially  from  the 
standard  ±«  conventions.  If  z(x)  is  finite,  it  is  Lipschitz  (7.7) 
and  thus  continuous,  i.e.,  attains  its  minimum  on  K  »  Kj  O  K2  which  is 
compact  since  it  is  bounded  by  assumption  and  closed  since  it  is  the 
intersection  of  a  closed  polyhedron  Kj  and  the  closed  set  K2  (Theorem 
(4.7)).  Thus  (8.1)  is  solvable.  It  remains  to  be  shown  that  in  this  case 
it  is  also  dualizable.  This  follows  in  a  rather  straightforward  fashion 
from  [Van  Slyke  and  Wets,  1968;  Proposition  (5.1)]  and  the  observation 
that  the  compactness  of  K  and  the  continuity  of  z(x)  is  sufficient  to 
establish  that  the  epigraph  6  of  the  variational  function 
<Ky)  *  {Min  z(x)|x  e  K-y}  is  a  closed  set. 

Easy  examples  of  stochastic  programs  with  recourse  can  be  found, 
satisfying  all  hypotheses  of  the  previous  theorem  except  the  boundedness 
of  K,  whose  infimum  is  finite  but  which  are  not  solvable.  In  [Williams, 
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1965]  one  can  find  a  detailed  characterization  of  this  situation  for 
stochastic  program  with  simple  recourse.  The  dualizability  of  (8.2) 
also  requires  some  restrictions.  The  following  example  which  has 
only  T  random  and  K  unbounded  possesses  a  deterministic  equivalent 
program  which  is  not  dualizable;  in  fact,  in  this  case  there  is  an 
infinite  duality  gap. 


where  has  a  continuous  distribution  on  (1,®)  with  density 

_2 

f(£j)  ■  and  "  ^1  ~  has  811  0Ptimal  value  of  0.  The 

optimum  value  of  the  dual  of  the  deterministic  equivalent  program  is 
-®.  It  is  not  known  if  there  exist  stochastic  programs  (with  fixed 
recourse  or  not)  whose  deterministic  equivalent  programs  exhibit  a  finite 
duality  gap. 


The  following  lemma  proved  in  [Walkup  and  Wets,  1969— d ]  is  parti¬ 
cularly  useful  since  it  is  immediately  applicable  to  all  stochastic  programs 
whose  constraints  determine  a  polyhedral  region.  Theorems  (4.7),  (4.10) 
and  Corollary  (4.13)  have  shown  that  this  will  be  the  case  in  all  but  the 
most  sophisticated  applications. 


Lemma  (8.6).  Consider  Che  mathematical  program 


(8.7)  Minimize  f(x) 

subject  to  Ax  ■  b , 
x  >  0 

where  the  objective  f  is  convex  and  Lipschitz  on  a  polyhedron  and  (8.7) 
is  finite,  then  (8.7)  is  stable. 

Theorem  (8.8).  Consider  a  stochastic  program  with  fixed  recourse  whose 
random  elements  satisfy  a  weak  covariance  condition.  Suppose  that  K 
is  polyhedral  and  the  program  is  finite.  Then  the  convex  program  (8.2) 
is  stable. 

Proof.  It  suffices  to  observe  that  by  Theorems  (7.6)  and  (7.7)  the  hypotheses 
of  the  Lemma  (8.6)  are  satisfied. 

To  see  that  the  hypotheses  of  Theorem  (8.8)  are  necessary  to  obtain 
stability,  consider  again  the  example  (8.5)  with  the  additional  fixed 
constraint  Xj  ■  1.  This  problem  has  a  finite  optimum,  in  fact,  is 
solvable.  However,  small  perturbations  of  the  constraints  will  change  the 
value  of  the  optimum  drastically.  It  is  ear.v  to  verify  that  the  dual  is  not 


solvable. 
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